-- Logs begin at Wed 2021-08-04 13:17:48 UTC, end at Wed 2021-08-04 14:23:00 UTC. -- Aug 04 13:47:56.429010 dv-cinder-792642-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 13:47:56.438827 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 4 13:47:56 2021] *** Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: nodename: dv-cinder-792642-6-iscsi Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: machine: x86_64 Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: clock source: unix Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: pcre jit disabled Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: detected number of CPU cores: 4 Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: current working directory: / Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: detected binary path: /usr/bin/uwsgi-core Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: your processes number limit is 47680 Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: your memory page size is 4096 bytes Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: detected max file descriptor number: 2048 Aug 04 13:47:56.440910 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: lock engine: pthread robust mutexes Aug 04 13:47:56.441836 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: thunder lock: enabled Aug 04 13:47:56.441836 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 13:47:56.441836 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 04 13:47:56.486543 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: Python main interpreter initialized at 0x55915022d9c0 Aug 04 13:47:56.486543 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: python threads support enabled Aug 04 13:47:56.486543 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: your server socket listen backlog is limited to 100 connections Aug 04 13:47:56.486543 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: your mercy for graceful operations on workers is 90 seconds Aug 04 13:47:56.486977 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 13:47:56.486977 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: *** Operational MODE: preforking *** Aug 04 13:47:56.487268 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: *** uWSGI is running in multiple interpreter mode *** Aug 04 13:47:56.487268 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: spawned uWSGI master process (pid: 92632) Aug 04 13:47:56.487482 dv-cinder-792642-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 13:47:56.489245 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: spawned uWSGI worker 1 (pid: 92633, cores: 1) Aug 04 13:47:56.489245 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: spawned uWSGI worker 2 (pid: 92634, cores: 1) Aug 04 13:47:56.489245 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 13:47:58.184002 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:47:58.184002 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: from cryptography.utils import int_from_bytes Aug 04 13:47:58.184736 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:47:58.184736 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: from cryptography.utils import int_from_bytes Aug 04 13:47:58.189101 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:47:58.189101 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: from cryptography.utils import int_from_bytes Aug 04 13:47:58.189572 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:47:58.189572 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: from cryptography.utils import int_from_bytes Aug 04 13:48:00.910252 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 13:48:00.910795 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 13:48:00.910976 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 13:48:00.911310 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 13:48:00.911568 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 13:48:00.911953 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.912297 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.912617 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.912932 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.913259 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.913567 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.913916 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.914232 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.914554 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.914809 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.915121 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.915540 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-792642-6-iscsi {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.915868 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.916173 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.916515 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.916829 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.917131 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.917449 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.917753 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.918250 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.918700 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.919005 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.919315 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.919651 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.919963 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.920286 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.920607 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.920912 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.921232 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.921542 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.921932 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-792642-6-iscsi {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.922240 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.922550 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.922862 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.923274 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.923578 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.923882 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.924198 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.924538 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.924839 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.925162 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.925480 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.925794 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.926112 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.926410 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.926713 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.927020 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.927336 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.927641 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.927943 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.928192 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.928514 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.928830 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.929147 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.929529 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.929780 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.930028 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.930343 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.930660 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.930962 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.931270 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.931571 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.931873 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.932175 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.932507 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.932809 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.933109 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.933422 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.933733 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.934048 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.934350 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.934665 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.935052 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.935299 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.935601 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.935938 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.936271 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.936582 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.936897 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.937212 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.937772 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.938080 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.938384 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.938789 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.939020 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.939321 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.939569 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.939864 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.940165 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.940504 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.940808 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.941110 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.941415 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.941712 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.942013 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.942314 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.942617 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.942919 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.943219 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.943517 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.943817 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.944115 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.944437 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.944754 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.945595 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.945944 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.946198 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.946499 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.946803 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.947120 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.947423 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.947725 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.948040 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.948362 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.948665 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.948977 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.949281 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.949581 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.949895 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.950193 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.950495 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.950808 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.951110 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.951411 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.951717 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.952018 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.952337 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.952638 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.952935 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.953231 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.953527 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.953840 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.954156 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.954461 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.954792 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.955060 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.955374 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:00.955705 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.956035 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.956437 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.956719 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.957049 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.957377 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.957694 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.958005 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.958316 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.958639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.958948 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.959256 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.959562 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.959874 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.960187 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.960584 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.961525 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.962044 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.962371 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.962686 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.963003 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.963327 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.963649 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.963959 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.964323 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.964663 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.964977 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.965297 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.965607 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.965927 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.966236 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.966544 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.966852 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.967165 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.967474 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.967780 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.968111 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.968446 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.968763 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.969067 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.969369 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.969673 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.969981 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.970283 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.970599 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.970923 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.971225 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.971557 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.971866 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.972175 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.972533 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.972804 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.973110 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.973416 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.973717 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.974037 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.974346 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.974650 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.975015 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.975269 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.975572 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.975882 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.976273 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.976641 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.977033 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.977357 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.977670 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.977978 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.978310 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.978643 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.978951 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.979278 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.979603 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.979919 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.980238 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.980554 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.980860 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.981164 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.981525 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.981841 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.982147 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.982452 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.982754 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.983056 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.983360 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.983681 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.983989 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.984323 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.984627 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.984928 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.985277 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.985582 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.985915 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.986252 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.986546 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.986862 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.987169 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.987473 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.987776 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.988085 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.988431 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.988738 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.989044 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.989346 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.989652 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.989970 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.990298 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.990605 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.990913 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.991231 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.991538 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.991887 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.992271 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.992672 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.992979 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.993290 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.993603 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.993910 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.994217 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.994519 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.994830 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.995135 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.995438 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.995736 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.996041 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.996383 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.996694 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.997012 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.997332 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.997633 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.997932 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.998249 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.998555 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.998856 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.999156 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.999454 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:00.999792 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.000096 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.000416 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.000733 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.001054 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.001360 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.001679 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.001985 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.002289 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.002606 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.002918 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.003223 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.003530 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.003835 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.004143 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.004475 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.004794 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.005102 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.005487 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.005808 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.006109 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.006415 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.006725 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.007311 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.008182 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.008519 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.008837 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.009152 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.009464 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.009792 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.010116 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.010425 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.010726 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.011032 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.011333 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.011637 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.011945 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.012263 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.012567 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.012866 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.013171 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.013470 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.013769 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.014066 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.014366 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.014674 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.014971 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.015278 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.015579 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.015893 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.016196 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.016608 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.016915 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.017215 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.017554 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.017855 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.018188 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.018516 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.018853 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.019192 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.019496 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.019819 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.020121 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.020445 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.020746 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.021053 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.021357 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.021659 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.021977 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.022280 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.022584 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.022886 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.023783 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.024091 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.024418 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.024732 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.025038 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.025345 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.025647 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.025952 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.026257 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.026556 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.026861 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.027160 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.027471 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.027773 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.028074 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.028399 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.028706 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.029010 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.029309 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.029628 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.029938 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.030310 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.030544 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.030843 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.031143 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.031448 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.031772 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.032087 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.032412 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.032720 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.033019 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.033322 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.033620 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.033923 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.034221 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.034518 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.034814 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.035112 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.035411 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.035734 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.036036 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.036358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.036661 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.036958 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.037300 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.037600 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.037955 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.038257 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.038569 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.039434 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.039744 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.040052 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.040387 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.040691 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.041006 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.041315 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.041630 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.041931 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.042232 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.042550 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.042858 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.043164 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.043480 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.043798 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.044119 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.044444 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.044751 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.045056 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.045359 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.045666 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.045973 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.046276 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.046593 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.046896 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.047199 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.047504 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.047806 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.048111 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.048551 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.048741 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.049062 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.049365 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.049668 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.049974 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.050274 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.050575 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.050876 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.051309 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.051622 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.051965 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.052243 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.052554 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.052863 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.053169 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.053480 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.053781 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.054196 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.055066 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.055376 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.055684 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.056001 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.056305 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.056615 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.056937 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.057245 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.057545 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.057846 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.058165 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.058465 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.058780 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.059206 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.059514 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.059816 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.060255 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.060558 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.060865 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.061185 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.061512 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.061834 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.062136 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.062449 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.063013 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.063334 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.063655 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.063965 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.064297 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.064603 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.064923 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.065242 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.065553 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.065873 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.066285 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.066604 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.066912 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.067230 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.067548 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.067852 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.068153 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.068484 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.068787 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.069090 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.069409 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.069712 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.070122 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.070664 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.071217 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.079258 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.079258 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.079258 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.079258 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.079258 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.079258 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.079258 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.079258 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.080639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.080639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.080639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.080639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.080639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.080639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.080639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.080639 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.081869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.081869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.081869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.081869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.081869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.081869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.081869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.081869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.083101 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.083101 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.083101 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.083101 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.083101 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.083101 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.083101 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.083101 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.084358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.084358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.084358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.084358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.084358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.084358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.084358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.084358 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.085694 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.085694 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.085694 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.085694 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.085694 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.086460 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.086460 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.086460 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.086935 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.087102 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.087381 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.087696 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.088009 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.088344 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.088658 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.088971 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.089383 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.089591 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.089904 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.090215 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.090528 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.091096 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.091428 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.091739 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.092050 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.092382 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.092698 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.093008 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.093313 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.093626 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.093943 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.094248 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.094572 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.094896 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.095226 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.095565 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.095877 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.096187 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.096523 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.096843 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.097206 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.097523 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.097830 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.098151 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.098470 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.098782 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.099096 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.099425 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.099745 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.100019 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.100356 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.100667 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.100981 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.101824 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.102153 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.102575 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.102896 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.103210 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.103524 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.103837 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.104439 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.104966 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.105557 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.106134 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.106711 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.107265 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.107826 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.108427 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.108968 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.109506 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.110057 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.110591 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.111127 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.111710 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.112279 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.112824 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.113395 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.113916 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.114833 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.115435 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.115760 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.116418 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.116760 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.117771 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.118190 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.119438 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.119763 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.120084 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.120428 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.120748 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.121059 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.121430 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.121746 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.122058 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.122366 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.122834 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.123147 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.123477 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.123786 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.124095 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.124425 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.124739 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.125042 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.125348 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.125658 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.125963 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.126272 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.126576 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.126885 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.127183 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.127491 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.127801 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.128110 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.128581 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.128767 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.129120 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.129376 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.129695 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.130006 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.130328 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.130642 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.130957 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.131307 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.131621 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.132473 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.132931 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.133262 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.133619 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.133960 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.134270 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.134803 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.135126 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.135626 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.136108 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.139699 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.140060 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.140437 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.140777 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.141426 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.141760 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.142091 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.142416 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.142739 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.143094 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.143425 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.143750 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.144072 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.144478 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.144805 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.145118 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.145435 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.145768 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.146090 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.146427 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.146746 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.147056 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.147497 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.147812 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.148483 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.148818 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.149129 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.149462 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.149806 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.150141 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.150490 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.150773 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.151088 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.151392 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.151708 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.152053 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.152416 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.152741 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.153064 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.153382 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.153692 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.154288 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.154602 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.154925 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.155233 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.155557 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.155868 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.156184 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.156518 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.156843 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.157155 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.157548 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.157861 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.158175 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.158486 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.158801 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.159135 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.159449 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.159770 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.160081 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.160482 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.160782 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.161041 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.161364 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.161689 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.161997 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.162329 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.162638 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.162948 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.163257 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.163564 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.164437 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.164748 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.165071 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.165391 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.165695 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.166020 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.166337 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.166764 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.167172 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.167484 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.167814 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.168124 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.168462 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.168773 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.169083 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.169397 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.169708 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.170029 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.170355 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.170678 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.171000 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.171347 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.171657 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.172015 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.172366 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:01.172611 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 13:48:01.200629 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG oslo_db.sqlalchemy.engines [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:48:01.280543 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.context [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0356dad4-e903-4b66-9c79-fb26cbe69de2(cell1) {{(pid=92633) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 13:48:01.284745 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG oslo_concurrency.lockutils [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:48:01.286367 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG oslo_concurrency.lockutils [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:48:01.287164 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG oslo_concurrency.lockutils [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:48:01.290053 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG oslo_concurrency.lockutils [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:48:01.300185 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG oslo_db.sqlalchemy.engines [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:48:01.301025 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG oslo_db.sqlalchemy.engines [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:48:01.672389 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG oslo_db.sqlalchemy.engines [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:48:02.032481 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: WARNING keystonemiddleware.auth_token [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:48:02.039780 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: WARNING keystonemiddleware.auth_token [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:48:02.387390 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: WARNING keystonemiddleware.auth_token [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:48:02.392696 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: WARNING keystonemiddleware.auth_token [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:48:02.397957 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55915022d9c0 pid: 92633 (default app) Aug 04 13:48:02.400248 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:48:02.401455 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001835 Aug 04 13:48:02.401869 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 789 bytes} [Wed Aug 4 13:48:02 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:48:02.417053 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 13:48:02.417582 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 13:48:02.417791 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 13:48:02.418161 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 13:48:02.418419 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 13:48:02.418815 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.419141 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.419466 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.419790 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.420122 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.420464 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.420791 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.421117 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.421453 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.421721 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.422044 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.422374 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-792642-6-iscsi {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.422703 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.423016 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.423332 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.423769 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.423965 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.424319 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.424639 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.425171 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.425511 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.425804 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.426119 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.426488 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.426787 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.427105 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.427427 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.427740 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.428072 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.428426 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.428845 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-792642-6-iscsi {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.429171 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.430250 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.430580 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.431023 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.431344 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.431658 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.431986 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.432344 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.432661 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.433001 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.433328 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.433651 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.433980 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.434289 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.434603 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.434927 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.435258 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.435568 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.435885 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.436142 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.436486 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.436815 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.437141 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.437476 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.437994 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.438251 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.438577 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.438906 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.439222 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.439533 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.439845 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.440156 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.440505 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.440817 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.441126 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.441437 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.441766 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.442087 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.442416 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.442727 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.443052 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.443473 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.443727 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.444043 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.444430 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.444768 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.445119 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.445493 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.446073 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.446073 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.446382 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.446697 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.447024 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.447360 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.447665 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.447922 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.448328 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.448567 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.448893 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.449204 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.449517 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.449822 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.450864 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.450864 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.450864 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.451113 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.451320 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.451630 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.451937 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.452269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.452581 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.452889 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.453226 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.453559 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.453870 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.454177 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.454486 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.454804 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.455132 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.455440 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.455750 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.456077 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.456758 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.456758 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.457033 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.457342 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.457658 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.457983 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.458289 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.458602 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.458923 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.459234 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.459543 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.459846 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.460155 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.460618 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461018 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461627 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461627 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461627 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461627 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461627 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461627 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461627 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.461627 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.465282 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:48:02.465282 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.465282 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.465282 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.465282 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.465923 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.465923 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.466180 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.466314 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.466588 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.466924 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.467238 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.467557 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.467874 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.468198 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.468539 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.468874 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.469197 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.469516 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.469838 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.470154 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.470479 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.471223 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.471223 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.471474 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.471759 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.472108 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.472452 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.472783 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.473100 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.473427 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.473773 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.474044 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.474850 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.474850 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.475121 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.475277 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.475618 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.475944 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.477113 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.477113 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.477748 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.477748 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.478060 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.478375 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.478696 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.479028 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.479339 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.479677 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.479985 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.480326 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.480650 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.480955 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.481270 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.481584 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.481893 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.482221 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.482534 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.482842 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.483165 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.483473 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.483782 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.484106 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.484474 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.484755 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.485070 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.485399 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.485715 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.486034 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.486367 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.486701 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.487008 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.487340 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.487673 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.487995 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.488332 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.488649 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.488955 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.489267 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.489580 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.489896 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.490200 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.490510 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.490821 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.491130 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.491436 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.491790 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.492686 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.493001 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.493306 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.493613 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.493971 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.494393 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.494606 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.494928 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.495254 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.495572 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.495889 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.496203 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.496534 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.496852 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.497191 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.497484 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.497798 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.498106 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.498423 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.498752 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.499087 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.499397 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.499711 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.500038 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.500378 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.500686 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.501002 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.501313 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.501619 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.501932 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.502246 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.502559 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.502876 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.503182 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.503500 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.503816 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.504125 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.504453 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.504767 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.505091 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.505404 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.505728 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.506053 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.506360 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.506666 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.506991 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.507303 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.508407 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.508511 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.508824 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.509171 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.509480 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.510161 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.510161 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.510416 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.510730 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.511056 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.511368 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.511679 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.512009 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.512356 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.512667 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.512978 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.513291 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.514342 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.514342 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.514342 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.514834 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.514834 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.515193 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.515420 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.515734 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.516052 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.516672 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.517009 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.517942 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.517942 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.517942 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.518295 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.518589 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.518922 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.519243 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.519551 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.519864 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.520174 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.520510 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.520827 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.521133 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.521443 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.521758 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.522070 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.522378 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.522684 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.523147 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.524670 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.524670 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.524670 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.525131 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.525131 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.525449 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.525765 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.526072 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.526379 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.526681 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.527029 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.527337 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.527680 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.528011 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.528376 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.528688 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.528994 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.529324 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.529634 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.529942 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.530250 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.530565 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.530877 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.531182 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.531506 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.531820 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.532130 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.532464 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.532771 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.533082 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.533388 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.533710 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.534021 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.534325 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.534631 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.534944 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.535255 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.535560 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.535872 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.536175 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.536518 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.536826 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.537135 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.537440 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.537753 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.538064 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.538367 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.540364 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.540364 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.540364 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.540364 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.540881 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.540881 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.541089 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.541361 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.541681 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.541992 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.542308 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.542615 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.542925 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.543238 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.543549 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.543859 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.544167 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.544498 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.544808 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.545127 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.545453 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.545772 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.546076 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.546378 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.546705 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.547037 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.547346 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.547712 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.548023 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.548367 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.548694 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.549008 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.549325 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.549642 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.549948 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.550262 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.550575 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.550892 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.551202 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.551509 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.551830 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.552144 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.552488 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.552812 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.553138 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.553461 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.553775 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.554090 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.554971 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.555269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.555632 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.555882 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.556197 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.556535 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.556848 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.557160 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.557471 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.557781 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.558100 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.558411 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.558714 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.559043 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.559352 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.559657 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.559970 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.560319 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.560612 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.560923 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.561365 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.561683 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.561993 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.562300 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.562874 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.563190 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.563507 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.563830 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.564138 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.564590 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.564914 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.565229 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.565545 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.565855 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.566164 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.566478 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.566805 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.567114 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.567423 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.567731 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.568060 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.568393 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.568718 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.569144 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.569461 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.569770 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.570482 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.570482 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.570844 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.571172 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.571500 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.571831 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.572140 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.572487 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.572803 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.573132 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.573460 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.573783 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.574103 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.574410 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.574739 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.575065 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.575382 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.575708 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.576136 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.576488 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.576804 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.577132 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.577512 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.578363 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.578363 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.578363 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.578792 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.578969 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.579297 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.579623 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.579920 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.580436 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.580601 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.580871 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.581178 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.581502 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.581810 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.582135 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.582452 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.582780 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.583105 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.583412 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.583743 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.584058 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.584397 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.584702 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.585020 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.585368 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.585705 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.586055 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.586437 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.586787 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.587106 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.587468 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.587786 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.588088 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.588433 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.588761 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.589074 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.589380 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.589698 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.590005 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.590313 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.590620 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.590931 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.591238 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.591544 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.591896 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.592440 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.592966 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.593519 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.594073 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.594561 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.595072 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.595578 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.596203 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.597955 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.598590 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.599163 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.599521 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.599875 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.600207 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.600576 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.600915 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.601788 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.602127 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.602456 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.602780 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.603116 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.603437 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.603759 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.604096 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.604451 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.604780 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.605365 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.605705 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.606030 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.606353 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.606731 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.606973 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.607292 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.607610 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.607924 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.608254 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.608582 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.608918 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.609245 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.609583 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.609940 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.610269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.610590 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.610916 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.611241 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.611616 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.611942 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.612283 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.612614 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.612943 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.613270 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.613604 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.613919 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.614244 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.614569 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.614890 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.615203 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.615520 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.615838 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.616167 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.616540 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.617513 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.617792 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.618260 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.618590 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.619145 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.619467 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.619806 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.620147 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.624647 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.624647 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.624647 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.624647 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.624647 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.624647 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.624647 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.624647 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.627269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.627269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.627269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.627269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.627269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.627269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.627269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.627269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628233 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628233 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628233 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628233 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628233 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628233 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628233 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628233 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628845 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628845 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.628845 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.629251 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.629384 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.629631 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.629938 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.630251 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.630560 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.630893 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.631205 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.631516 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.631825 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.632141 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.633009 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.633469 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.633785 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.634096 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.634419 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.634730 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.635046 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.635355 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.635670 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.635978 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.636317 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.636628 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.636960 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.637272 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.637581 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.637912 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.638227 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.638555 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.638871 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.639186 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.639540 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.639865 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.640694 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.641036 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.641403 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.641702 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.642047 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.642356 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.642671 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.642983 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.643311 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.643625 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.643940 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.644295 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.644600 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.644916 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.645231 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.645543 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.645860 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.646173 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.646486 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.646834 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.647157 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.647475 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.647793 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.648837 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.649169 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.649584 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.649903 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.650242 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.650567 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.650905 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.651223 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.651537 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.651974 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.652325 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.652646 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.652979 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.653296 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.653631 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.653979 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.654312 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.654649 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.654958 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.655266 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.655576 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.655888 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.656268 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.656599 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.656924 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.657251 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.657568 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.657884 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.658196 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.658511 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.658824 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.659136 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.659456 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.659775 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.660096 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.660434 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.660765 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.661079 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.661400 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.661705 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.662024 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.662335 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.662655 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.662992 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.663308 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.663741 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.664060 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.664436 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.664749 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.665180 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.665429 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.665715 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.666030 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.666366 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.666683 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.667002 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.667317 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.667629 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.667941 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.668292 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.668625 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.668954 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.669260 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.669588 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.669909 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.670228 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.670546 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.670859 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.671191 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.671501 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.671814 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.672129 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.674536 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.674536 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.674536 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.674536 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.675279 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.675279 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.675427 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.675703 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.677702 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.677702 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.677702 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:48:02.677702 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 13:48:02.702899 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_db.sqlalchemy.engines [None req-8f6cee03-f112-4951-b972-05f81271017a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:48:02.784690 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.context [None req-8f6cee03-f112-4951-b972-05f81271017a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0356dad4-e903-4b66-9c79-fb26cbe69de2(cell1) {{(pid=92634) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 13:48:02.789751 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-8f6cee03-f112-4951-b972-05f81271017a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:48:02.791351 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-8f6cee03-f112-4951-b972-05f81271017a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:48:02.792160 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-8f6cee03-f112-4951-b972-05f81271017a None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:48:02.794155 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-8f6cee03-f112-4951-b972-05f81271017a None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:48:02.806821 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_db.sqlalchemy.engines [None req-8f6cee03-f112-4951-b972-05f81271017a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:48:02.809298 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_db.sqlalchemy.engines [None req-8f6cee03-f112-4951-b972-05f81271017a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:48:03.182621 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_db.sqlalchemy.engines [None req-8f6cee03-f112-4951-b972-05f81271017a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:48:03.516396 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: WARNING keystonemiddleware.auth_token [None req-8f6cee03-f112-4951-b972-05f81271017a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:48:03.523758 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: WARNING keystonemiddleware.auth_token [None req-8f6cee03-f112-4951-b972-05f81271017a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:48:03.876590 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: WARNING keystonemiddleware.auth_token [None req-8f6cee03-f112-4951-b972-05f81271017a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:48:03.882051 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: WARNING keystonemiddleware.auth_token [None req-8f6cee03-f112-4951-b972-05f81271017a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:48:03.888355 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55915022d9c0 pid: 92634 (default app) Aug 04 13:49:29.516870 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:29.518594 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Aug 04 13:49:29.520412 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:29 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:30.075951 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-59638c2b-74bb-4c26-b6d1-886a86fb84a7 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:30.107045 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-59638c2b-74bb-4c26-b6d1-886a86fb84a7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.572816 Aug 04 13:49:30.107780 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1292 bytes} [Wed Aug 4 13:49:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:49:32.456589 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:32.458981 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-6409ff80-42ac-495a-91a7-ecb95f6e45c1 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003207 Aug 04 13:49:32.460160 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:32 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:32.534755 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-8361758d-bc1c-4879-91a5-60d703f44983 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "vcpus": 1, "name": "cirros256", "ram": 256}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:32.554900 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:49:32.554900 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: warnings.warn(msg) Aug 04 13:49:32.603642 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-8361758d-bc1c-4879-91a5-60d703f44983 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.135264 Aug 04 13:49:32.612195 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:32 2021] POST /compute/v2.1/flavors => generated 407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:49:32.843397 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-769738de-64db-43c8-8ebc-f0fb9c3779ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:32.847953 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:49:32.847953 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: warnings.warn(msg) Aug 04 13:49:32.929467 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-769738de-64db-43c8-8ebc-f0fb9c3779ff admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.315313 Aug 04 13:49:32.930301 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Aug 4 13:49:32 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:49:35.381519 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-8361758d-bc1c-4879-91a5-60d703f44983 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:35.382329 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-8361758d-bc1c-4879-91a5-60d703f44983 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 04 13:49:35.382551 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:35.498025 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-ee296e25-aec3-4fb3-9629-5387372f86a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:35.517664 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:49:35.517664 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: warnings.warn(msg) Aug 04 13:49:35.537841 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-ee296e25-aec3-4fb3-9629-5387372f86a5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148157 Aug 04 13:49:35.538404 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:49:35.550385 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-3c99722d-7aa5-4581-b620-1814230dfac9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:35.552036 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:49:35.552036 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: warnings.warn(msg) Aug 04 13:49:35.585184 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-3c99722d-7aa5-4581-b620-1814230dfac9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038307 Aug 04 13:49:35.585726 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Aug 4 13:49:35 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:49:37.841796 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-ee296e25-aec3-4fb3-9629-5387372f86a5 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:37.843035 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-ee296e25-aec3-4fb3-9629-5387372f86a5 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Aug 04 13:49:37.843518 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:37.908110 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-7106938d-a051-4b1a-b3ae-0a470c5a52a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "id": "d2"}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:37.931765 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-7106938d-a051-4b1a-b3ae-0a470c5a52a3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079745 Aug 04 13:49:37.932703 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:49:37.946210 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-74775f3c-f759-498c-918a-eba595dbbd4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:37.970525 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-74775f3c-f759-498c-918a-eba595dbbd4b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028845 Aug 04 13:49:37.971514 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Aug 4 13:49:37 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:49:40.227950 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-7106938d-a051-4b1a-b3ae-0a470c5a52a3 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:40.229138 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-7106938d-a051-4b1a-b3ae-0a470c5a52a3 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Aug 04 13:49:40.229747 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:40.306616 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-b144b317-a2e0-481e-b85a-f90048893cc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:40.329221 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-b144b317-a2e0-481e-b85a-f90048893cc0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091779 Aug 04 13:49:40.333419 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:49:40.343372 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-a52924bf-9af9-4071-9ae5-f7d67c627596 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:40.377342 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-a52924bf-9af9-4071-9ae5-f7d67c627596 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037719 Aug 04 13:49:40.379083 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Aug 4 13:49:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:49:42.615858 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-b144b317-a2e0-481e-b85a-f90048893cc0 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:42.616898 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-b144b317-a2e0-481e-b85a-f90048893cc0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 04 13:49:42.617364 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:49:42.678605 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-69fa7662-1b38-46c6-aef7-84a9b08453ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:42.698633 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-69fa7662-1b38-46c6-aef7-84a9b08453ad admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073975 Aug 04 13:49:42.699553 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:49:42.712846 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-b01b14b4-49a8-4c50-84ee-2a965ae75573 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:42.738222 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-b01b14b4-49a8-4c50-84ee-2a965ae75573 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028911 Aug 04 13:49:42.739412 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1336 bytes} [Wed Aug 4 13:49:42 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:49:45.018206 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-69fa7662-1b38-46c6-aef7-84a9b08453ad admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:45.019221 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-69fa7662-1b38-46c6-aef7-84a9b08453ad admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 04 13:49:45.019882 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:45.082702 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-78a3f96b-09a5-4281-8d2a-bf90746e20a4 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:45.108591 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-78a3f96b-09a5-4281-8d2a-bf90746e20a4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081435 Aug 04 13:49:45.110338 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1292 bytes} [Wed Aug 4 13:49:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:49:47.414454 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-69fa7662-1b38-46c6-aef7-84a9b08453ad admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:47.416001 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-69fa7662-1b38-46c6-aef7-84a9b08453ad admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Aug 04 13:49:47.416617 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:47 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:47.483808 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-218a5fc9-cc84-451d-a126-f4d48a6e89bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1"}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:47.508674 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-218a5fc9-cc84-451d-a126-f4d48a6e89bb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082620 Aug 04 13:49:47.509783 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:47 2021] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:49:47.525606 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-3e2e099e-a290-4355-85c6-31b17ec69002 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:47.564424 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-3e2e099e-a290-4355-85c6-31b17ec69002 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045038 Aug 04 13:49:47.565390 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Aug 4 13:49:47 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:49:50.064028 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-218a5fc9-cc84-451d-a126-f4d48a6e89bb admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:50.065166 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-218a5fc9-cc84-451d-a126-f4d48a6e89bb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Aug 04 13:49:50.065602 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:50.136299 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-cf5760c5-301a-48d9-8f13-54bb21b196d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "disk": 20}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:50.155944 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-cf5760c5-301a-48d9-8f13-54bb21b196d6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079645 Aug 04 13:49:50.156648 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:49:50.174165 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-cc3d216d-40b4-4257-962a-a1a8673ccbf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:50.204493 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-cc3d216d-40b4-4257-962a-a1a8673ccbf4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037723 Aug 04 13:49:50.205115 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Aug 4 13:49:50 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:49:52.590607 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-cf5760c5-301a-48d9-8f13-54bb21b196d6 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:52.591729 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-cf5760c5-301a-48d9-8f13-54bb21b196d6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 04 13:49:52.592142 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:52.651871 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-4f83e78a-7a11-4159-8f48-1b537117d566 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:52.669661 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-4f83e78a-7a11-4159-8f48-1b537117d566 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069904 Aug 04 13:49:52.670322 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:52 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:49:52.684546 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-ef3f22e3-e809-418c-b1e2-1780418d67f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:52.708487 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-ef3f22e3-e809-418c-b1e2-1780418d67f4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027612 Aug 04 13:49:52.709084 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Aug 4 13:49:52 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:49:55.059339 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-4f83e78a-7a11-4159-8f48-1b537117d566 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:55.060707 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-4f83e78a-7a11-4159-8f48-1b537117d566 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Aug 04 13:49:55.061116 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:55.122377 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-1d2e122a-fe40-4c42-9584-32b718c1b424 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:55.141534 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-1d2e122a-fe40-4c42-9584-32b718c1b424 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072067 Aug 04 13:49:55.142086 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:49:55.155150 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-0a24e3a0-a07a-4e33-9297-b39226af5697 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:55.180510 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-0a24e3a0-a07a-4e33-9297-b39226af5697 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029361 Aug 04 13:49:55.181298 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Aug 4 13:49:55 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:49:57.481848 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-1d2e122a-fe40-4c42-9584-32b718c1b424 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:49:57.483083 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-1d2e122a-fe40-4c42-9584-32b718c1b424 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001847 Aug 04 13:49:57.483488 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:49:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:49:57.547676 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-2f3f8d83-f299-4749-bc3f-72d31c17c4ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:57.567999 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-2f3f8d83-f299-4749-bc3f-72d31c17c4ba admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077055 Aug 04 13:49:57.568591 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1283 bytes} [Wed Aug 4 13:49:57 2021] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:49:57.580754 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-69c0216b-ae66-466e-87c9-c8202488cf5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:49:57.608116 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-69c0216b-ae66-466e-87c9-c8202488cf5b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030953 Aug 04 13:49:57.609351 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1333 bytes} [Wed Aug 4 13:49:57 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:50:38.614380 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-2f3f8d83-f299-4749-bc3f-72d31c17c4ba admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:38.615398 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-2f3f8d83-f299-4749-bc3f-72d31c17c4ba admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 04 13:50:38.615805 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:50:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:50:38.679655 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-8233ba1b-be38-4f9c-9019-7b70d435e07c admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:38.697994 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-8233ba1b-be38-4f9c-9019-7b70d435e07c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075013 Aug 04 13:50:38.698567 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1292 bytes} [Wed Aug 4 13:50:38 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:50:40.183699 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-2f3f8d83-f299-4749-bc3f-72d31c17c4ba admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:40.184806 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-2f3f8d83-f299-4749-bc3f-72d31c17c4ba admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 04 13:50:40.185207 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:50:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:50:40.382325 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-07ce26c6-041a-4ecd-9856-2a072d030a3e admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:40.387977 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.wsgi [None req-07ce26c6-041a-4ecd-9856-2a072d030a3e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 13:50:40.388590 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-07ce26c6-041a-4ecd-9856-2a072d030a3e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:50:40.389402 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-07ce26c6-041a-4ecd-9856-2a072d030a3e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.058547 Aug 04 13:50:40.390048 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1191 bytes} [Wed Aug 4 13:50:40 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:50:40.401111 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-496bd086-d1bc-4c04-a4a1-bbac71c5c3d6 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:40.422974 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-496bd086-d1bc-4c04-a4a1-bbac71c5c3d6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025395 Aug 04 13:50:40.423558 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Aug 4 13:50:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:50:40.434874 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-3734f089-4e61-4481-927c-e7532672ef26 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:40.456565 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-3734f089-4e61-4481-927c-e7532672ef26 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025064 Aug 04 13:50:40.457140 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Aug 4 13:50:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:50:40.467400 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-145fa003-ed06-4b3b-9749-84654e710582 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:40.473613 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.wsgi [None req-145fa003-ed06-4b3b-9749-84654e710582 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 13:50:40.474189 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-145fa003-ed06-4b3b-9749-84654e710582 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:50:40.475004 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-145fa003-ed06-4b3b-9749-84654e710582 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.011237 Aug 04 13:50:40.475538 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1191 bytes} [Wed Aug 4 13:50:40 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:50:41.892530 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-3734f089-4e61-4481-927c-e7532672ef26 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:41.893544 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-3734f089-4e61-4481-927c-e7532672ef26 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 04 13:50:41.894526 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:50:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:50:42.087125 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-612c5337-76c1-4b44-82bd-3fd200865b72 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:42.092960 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.wsgi [None req-612c5337-76c1-4b44-82bd-3fd200865b72 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 13:50:42.093554 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-612c5337-76c1-4b44-82bd-3fd200865b72 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:50:42.094381 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-612c5337-76c1-4b44-82bd-3fd200865b72 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.061939 Aug 04 13:50:42.094937 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1191 bytes} [Wed Aug 4 13:50:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:50:42.105192 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-aafd2eb1-5e8a-4d78-9167-56569256cf77 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:42.118596 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-aafd2eb1-5e8a-4d78-9167-56569256cf77 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017076 Aug 04 13:50:42.119135 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Aug 4 13:50:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:50:42.129940 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-c958dda4-7aea-430b-9398-3484d628cd76 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:42.143619 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-c958dda4-7aea-430b-9398-3484d628cd76 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017734 Aug 04 13:50:42.144950 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Aug 4 13:50:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:50:42.155039 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-6c64eb84-9f8c-46b4-b21d-69b6fdae4156 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:42.160623 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.wsgi [None req-6c64eb84-9f8c-46b4-b21d-69b6fdae4156 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 13:50:42.161197 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-6c64eb84-9f8c-46b4-b21d-69b6fdae4156 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:50:42.161999 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-6c64eb84-9f8c-46b4-b21d-69b6fdae4156 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010561 Aug 04 13:50:42.162522 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1191 bytes} [Wed Aug 4 13:50:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 13:50:43.525577 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-c958dda4-7aea-430b-9398-3484d628cd76 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:43.526619 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-c958dda4-7aea-430b-9398-3484d628cd76 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Aug 04 13:50:43.527013 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:50:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:50:43.719300 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-12f618a1-576f-453c-bb80-c66931718ab4 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:43.725704 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.wsgi [None req-12f618a1-576f-453c-bb80-c66931718ab4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 13:50:43.726269 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-12f618a1-576f-453c-bb80-c66931718ab4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:50:43.727062 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-12f618a1-576f-453c-bb80-c66931718ab4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.057701 Aug 04 13:50:43.727570 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Aug 4 13:50:43 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 13:50:43.737400 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-0a81c016-be13-4060-8e8a-bf112aec04ec admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:43.750823 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-0a81c016-be13-4060-8e8a-bf112aec04ec admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016990 Aug 04 13:50:43.751349 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Aug 4 13:50:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:50:43.761428 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:43.775842 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017906 Aug 04 13:50:43.776395 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1211 bytes} [Wed Aug 4 13:50:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:50:43.786746 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-b136966a-1b8b-4a14-8170-1ad85641a2d3 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:43.791944 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.wsgi [None req-b136966a-1b8b-4a14-8170-1ad85641a2d3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 13:50:43.792545 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-b136966a-1b8b-4a14-8170-1ad85641a2d3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:50:43.793348 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-b136966a-1b8b-4a14-8170-1ad85641a2d3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010774 Aug 04 13:50:43.793845 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Aug 4 13:50:43 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:50:45.189561 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:45.191145 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Aug 04 13:50:45.191521 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:50:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:50:45.382497 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-526c56cf-9bfc-4574-a3b4-5938b486860f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:50:45.401465 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-526c56cf-9bfc-4574-a3b4-5938b486860f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.070316 Aug 04 13:50:45.401921 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1236 bytes} [Wed Aug 4 13:50:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:50:46.769435 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:46.770502 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Aug 04 13:50:46.770890 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:50:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:50:46.958516 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-7a61b181-a8af-4e20-aab0-f1bd385f3e48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:50:46.984330 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-7a61b181-a8af-4e20-aab0-f1bd385f3e48 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.076481 Aug 04 13:50:46.984885 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1236 bytes} [Wed Aug 4 13:50:46 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:50:48.382941 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:48.383936 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 04 13:50:48.384359 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:50:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:50:48.571521 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-fef86478-0e9c-4f7c-8ae5-dc24d3a6cc9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:50:48.590260 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-fef86478-0e9c-4f7c-8ae5-dc24d3a6cc9b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.067701 Aug 04 13:50:48.590841 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1236 bytes} [Wed Aug 4 13:50:48 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:50:49.977828 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:49.978836 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 04 13:50:49.979236 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:50:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:50:50.171106 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-b33e92c4-1673-4f37-9298-63ed4b81c524 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:50:50.190456 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-b33e92c4-1673-4f37-9298-63ed4b81c524 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.071882 Aug 04 13:50:50.191058 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1236 bytes} [Wed Aug 4 13:50:50 2021] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:50:51.557213 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:51.558208 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 04 13:50:51.558597 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:50:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:50:51.748134 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-8a9d7803-143d-4300-a43e-449d782aa098 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:50:51.768348 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-8a9d7803-143d-4300-a43e-449d782aa098 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.070394 Aug 04 13:50:51.768888 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1203 bytes} [Wed Aug 4 13:50:51 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:51:39.351835 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:39.352872 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-35cce3d7-cd30-4922-bb70-5c9f803f3f51 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 04 13:51:39.353312 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 931 bytes} [Wed Aug 4 13:51:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:51:39.409529 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-e6d47ce7-511d-4c5d-b664-046b1d10a0d2 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:39.428560 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-e6d47ce7-511d-4c5d-b664-046b1d10a0d2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068780 Aug 04 13:51:39.429078 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1292 bytes} [Wed Aug 4 13:51:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:51:39.451769 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-d019a8f2-66e9-4286-8a9a-f5d18b56804d admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:39.459691 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-d019a8f2-66e9-4286-8a9a-f5d18b56804d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011444 Aug 04 13:51:39.460298 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1283 bytes} [Wed Aug 4 13:51:39 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:51:39.472666 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-011e0b04-712e-45ad-a3ec-daebe4a74de1 admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:39.480460 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-011e0b04-712e-45ad-a3ec-daebe4a74de1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011401 Aug 04 13:51:39.481076 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1286 bytes} [Wed Aug 4 13:51:39 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:51:39.494388 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-c4c0040f-4ddf-4938-a9d0-ae6fd3b3f769 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:39.502194 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-c4c0040f-4ddf-4938-a9d0-ae6fd3b3f769 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011786 Aug 04 13:51:39.502776 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1286 bytes} [Wed Aug 4 13:51:39 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:51:39.516351 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:39.524662 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011903 Aug 04 13:51:39.525185 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1283 bytes} [Wed Aug 4 13:51:39 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:52:59.272274 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-cdf8ac1e-50e6-4d3b-9b10-6a69c2d48e56 tempest-verify_tempest_config-536415911 tempest-verify_tempest_config-536415911-project] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:52:59.274252 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-cdf8ac1e-50e6-4d3b-9b10-6a69c2d48e56 tempest-verify_tempest_config-536415911 tempest-verify_tempest_config-536415911-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105424 Aug 04 13:52:59.274786 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1134 bytes} [Wed Aug 4 13:52:59 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:29.399038 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:29.400054 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 04 13:54:29.400498 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 36/70] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:54:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:29.658745 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-247d8d72-df20-4af5-b0b1-956848909d2e admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:29.661187 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:29.661187 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: warnings.warn(msg) Aug 04 13:54:29.663621 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-247d8d72-df20-4af5-b0b1-956848909d2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:54:29.664055 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-247d8d72-df20-4af5-b0b1-956848909d2e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:54:29.664855 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-247d8d72-df20-4af5-b0b1-956848909d2e admin admin] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:54:29.665278 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-247d8d72-df20-4af5-b0b1-956848909d2e admin admin] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:54:29.700173 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-247d8d72-df20-4af5-b0b1-956848909d2e admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.157910 Aug 04 13:54:29.700847 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 35/71] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Aug 4 13:54:29 2021] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:31.077817 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:31.078866 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 04 13:54:31.079260 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:54:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:31.273391 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-8a9edcca-29b5-4fba-ba79-268fcf796952 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:31.274532 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:31.274532 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: warnings.warn(msg) Aug 04 13:54:31.276021 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-8a9edcca-29b5-4fba-ba79-268fcf796952 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:54:31.276502 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-8a9edcca-29b5-4fba-ba79-268fcf796952 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:54:31.277278 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-8a9edcca-29b5-4fba-ba79-268fcf796952 admin admin] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:54:31.277697 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-8a9edcca-29b5-4fba-ba79-268fcf796952 admin admin] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:54:31.297010 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-8a9edcca-29b5-4fba-ba79-268fcf796952 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.075408 Aug 04 13:54:31.297574 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 36/73] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Aug 4 13:54:31 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:43.084562 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:43.085563 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 04 13:54:43.085964 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 38/74] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:54:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:43.279486 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-a87a5262-c7a7-4aae-aa9b-b40007c5f0b4 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:43.280674 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:43.280674 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: warnings.warn(msg) Aug 04 13:54:43.282177 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-a87a5262-c7a7-4aae-aa9b-b40007c5f0b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:54:43.282618 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-a87a5262-c7a7-4aae-aa9b-b40007c5f0b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:54:43.283397 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-a87a5262-c7a7-4aae-aa9b-b40007c5f0b4 admin admin] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:54:43.283824 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-a87a5262-c7a7-4aae-aa9b-b40007c5f0b4 admin admin] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:54:43.308067 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-a87a5262-c7a7-4aae-aa9b-b40007c5f0b4 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.078975 Aug 04 13:54:43.308729 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 37/75] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Aug 4 13:54:43 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:54:44.714028 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: DEBUG nova.api.openstack.wsgi [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] Calling method '>' {{(pid=92633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:44.715036 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: INFO nova.api.openstack.requestlog [None req-04269ea0-04ba-48c5-947a-570724a547bb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 04 13:54:44.715472 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: [pid: 92633|app: 0|req: 39/76] 10.222.0.43 () {56 vars in 1075 bytes} [Wed Aug 4 13:54:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:44.907100 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG nova.api.openstack.wsgi [None req-547add72-a888-4dd4-9760-7a3820fb01f5 admin admin] Calling method '>' {{(pid=92634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:44.908270 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:44.908270 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: warnings.warn(msg) Aug 04 13:54:44.910441 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-547add72-a888-4dd4-9760-7a3820fb01f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:54:44.910960 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-547add72-a888-4dd4-9760-7a3820fb01f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:54:44.911778 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-547add72-a888-4dd4-9760-7a3820fb01f5 admin admin] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:54:44.912196 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: DEBUG oslo_concurrency.lockutils [None req-547add72-a888-4dd4-9760-7a3820fb01f5 admin admin] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:54:44.933046 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: INFO nova.api.openstack.requestlog [None req-547add72-a888-4dd4-9760-7a3820fb01f5 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.075166 Aug 04 13:54:44.933519 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: [pid: 92634|app: 0|req: 38/77] 10.222.0.43 () {60 vars in 1194 bytes} [Wed Aug 4 13:54:44 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:43.151626 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: Wed Aug 4 13:55:43 2021 - graceful shutdown triggered... Aug 04 13:55:43.151750 dv-cinder-792642-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 13:55:43.152807 dv-cinder-792642-6-iscsi devstack@n-api.service[92634]: Gracefully killing worker 2 (pid: 92634)... Aug 04 13:55:43.153215 dv-cinder-792642-6-iscsi devstack@n-api.service[92633]: Gracefully killing worker 1 (pid: 92633)... Aug 04 13:55:44.153228 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: worker 1 buried after 1 seconds Aug 04 13:55:44.153228 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: worker 2 buried after 1 seconds Aug 04 13:55:44.153228 dv-cinder-792642-6-iscsi devstack@n-api.service[92632]: goodbye to uWSGI. Aug 04 13:55:44.154868 dv-cinder-792642-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 13:55:44.155442 dv-cinder-792642-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 13:55:44.158318 dv-cinder-792642-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 13:55:44.171935 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 13:55:44.175140 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 4 13:55:44 2021] *** Aug 04 13:55:44.175370 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 13:55:44.175719 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 13:55:44.175909 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: nodename: dv-cinder-792642-6-iscsi Aug 04 13:55:44.176393 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: machine: x86_64 Aug 04 13:55:44.176393 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: clock source: unix Aug 04 13:55:44.176393 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: pcre jit disabled Aug 04 13:55:44.176393 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: detected number of CPU cores: 4 Aug 04 13:55:44.176393 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: current working directory: / Aug 04 13:55:44.176393 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: detected binary path: /usr/bin/uwsgi-core Aug 04 13:55:44.177083 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: your processes number limit is 47680 Aug 04 13:55:44.177083 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: your memory page size is 4096 bytes Aug 04 13:55:44.177083 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: detected max file descriptor number: 2048 Aug 04 13:55:44.177083 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: lock engine: pthread robust mutexes Aug 04 13:55:44.177083 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: thunder lock: enabled Aug 04 13:55:44.177083 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 13:55:44.177083 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 04 13:55:44.223836 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: Python main interpreter initialized at 0x562aabcb79c0 Aug 04 13:55:44.223836 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: python threads support enabled Aug 04 13:55:44.223836 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: your server socket listen backlog is limited to 100 connections Aug 04 13:55:44.223836 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: your mercy for graceful operations on workers is 90 seconds Aug 04 13:55:44.224333 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 13:55:44.224333 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: *** Operational MODE: preforking *** Aug 04 13:55:44.224605 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: *** uWSGI is running in multiple interpreter mode *** Aug 04 13:55:44.224605 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: spawned uWSGI master process (pid: 107808) Aug 04 13:55:44.224816 dv-cinder-792642-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 13:55:44.225955 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: spawned uWSGI worker 1 (pid: 107822, cores: 1) Aug 04 13:55:44.225955 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: spawned uWSGI worker 2 (pid: 107823, cores: 1) Aug 04 13:55:44.225955 dv-cinder-792642-6-iscsi devstack@n-api.service[107808]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 13:55:46.106918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:55:46.106918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: from cryptography.utils import int_from_bytes Aug 04 13:55:46.107717 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:55:46.107717 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: from cryptography.utils import int_from_bytes Aug 04 13:55:46.114403 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:55:46.114403 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: from cryptography.utils import int_from_bytes Aug 04 13:55:46.115050 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:55:46.115050 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: from cryptography.utils import int_from_bytes Aug 04 13:55:48.720344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 13:55:48.721188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 13:55:48.721188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 13:55:48.722281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 13:55:48.722281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 13:55:48.722852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.723026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.723320 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.723584 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.723927 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.724262 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.724587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.724856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 13:55:48.725568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.725852 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 13:55:48.726106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.726106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.726573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 13:55:48.726859 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.727154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 13:55:48.727426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-792642-6-iscsi {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.727669 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 13:55:48.727912 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.728164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.728469 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.728747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.730937 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.731379 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.731771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.732177 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.732600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.732983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.733366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.733744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.734108 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.734452 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.734873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.735388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.735388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.736965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.737283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.738379 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.738635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.738869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.739104 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-792642-6-iscsi {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.739332 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.739660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.740409 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.740667 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.740923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.741164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.741408 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.741707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.741965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.742258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.742540 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.742770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.743008 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.743238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.743504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-792642-6-iscsi {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.743737 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.744013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.744318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.744715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.744965 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.745213 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.745461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.745705 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.751506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.751879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.752148 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.752433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.752688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.752968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.753385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.753637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.753883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.754127 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.754353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.754607 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.754859 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.755080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.755340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-792642-6-iscsi {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.755599 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.755847 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.756101 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.756396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.756632 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.756632 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.757078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.757310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.757660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.757909 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.758153 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.758398 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.758833 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.759119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.759119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.759589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.759817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.760065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.761893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.762173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.762438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.762677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.762924 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.763170 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.763444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.763444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.763923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.764156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.764430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.764665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.764914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.765184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.765400 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.765626 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.765877 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.766127 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.766380 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.766624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.766859 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.767098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.767338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.767616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.767863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.768098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.768895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.769124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.770176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.770439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.772273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.772560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.772805 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.773045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.773282 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.773282 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.773743 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.773972 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.774212 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.774427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.774666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.775352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.775611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.775851 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.776093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.776375 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.777105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.777355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.777566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.777792 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.778029 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.778264 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.778507 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.778742 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.778971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.779212 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.779456 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.779689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.779939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.780162 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.780491 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.780716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.782487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.782735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.783001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.783233 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.783485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.783485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.784590 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.784968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.785331 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.785566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.785819 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.786084 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.786515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.786770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.787012 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.787241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.787481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.787727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.787961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.788293 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.788544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.788788 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.789015 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.789252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.789501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.789742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.789972 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.790286 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.790588 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.790828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.791247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.792763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.793044 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.793285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.793531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.793770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.794014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.794271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.794480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.794715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.794948 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.795191 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.795428 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.795673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.795915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.796145 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.796397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.796610 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.796848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.797070 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.797278 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.797499 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.797723 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.797940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.798178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.798416 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.798641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.798870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.799101 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.799322 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.799589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.799829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.800071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.800331 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.800559 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.800784 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.801000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.801373 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.801631 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.803120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.803360 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.803563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.803761 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.803969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.804198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.804198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.804626 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.804844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.805065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.805294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.805508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.805718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.805938 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.806255 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.806490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.806490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.806900 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.807109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.807350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.807564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.807769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.808001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.808241 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.808486 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.808724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.808946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.809195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.809195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.809638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.809858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.810101 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.810332 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.810548 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.810762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.810984 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.811218 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.811616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.811616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.813330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.813572 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.813803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.813803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.814233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.814461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.814688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.814909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.815657 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.815913 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.816192 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.816500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.816724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.816970 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.817183 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.817417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.817637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.817863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.818093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.818312 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.818564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.818943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.819175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.819427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.819655 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.820124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:55:48.820391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.820599 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.820826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.821061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.821291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.821571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.821913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.822126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.823687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.823942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.824169 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.824470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.824734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.824972 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.825190 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.825420 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.825660 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.825891 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.826126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.826366 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.826588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.826799 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.827038 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.827271 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.827514 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.827761 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.827991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.828208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.828481 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.828711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.828939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.829177 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.829399 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.829608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.829823 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.830074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.830285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.830530 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.831651 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.831888 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.832042 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.832242 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.832412 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.834080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.834263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.834435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.834590 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.834771 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.834926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.835086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.835256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.835421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.835570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.835570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.835866 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.836013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.836184 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.836396 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.836583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.836750 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.836902 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.837063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.837218 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.837218 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.837519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.837666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.837813 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.837975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.838124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.838286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.838456 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.838456 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.838763 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.838919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.839081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.839252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.839429 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.839577 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.839724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.839885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.840037 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.840236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.840390 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.840557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.840714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.840877 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.841029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.841198 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.841348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.841492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.841642 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.841790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.841947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.842215 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.842376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.842526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.842696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.844320 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.844504 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.844674 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.844834 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.845004 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.845152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.852363 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.855020 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.855182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.855334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.855500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.855670 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.855823 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.855966 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.856106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.856296 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.856450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.856625 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.856786 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.856940 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.857088 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.857255 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.857421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.857598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.857755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.857907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.858059 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.858211 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.858379 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.858555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.858718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.858874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.859030 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.859220 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.859393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.859553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.859697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.859852 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.859998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.859998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.860331 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.860483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.860632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.860779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.860939 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.861083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.861241 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.861395 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.861553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.861712 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.861884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.862560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.862725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.862725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.863164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.863164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.863164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.863164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.863742 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.863899 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.864046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.864752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.864752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.865078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.865233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.865387 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.865546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.865546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.865814 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.865977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.866109 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.866246 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.866246 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.866505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.866651 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.866806 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.866961 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.867116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.867281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.867534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.867714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.867880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.868047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.868047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.868357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.868531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.868709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.868870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.869026 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.869175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.869334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.869483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.869651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.869797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.869797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.870078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.870222 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.870364 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.870553 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.870553 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.870854 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.871005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.871005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.871291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.871450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.871592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.871736 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.871736 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.872012 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.872181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.872361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.872518 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.872518 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.872786 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.872932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.873092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.873252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.873252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.873522 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.873678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.873837 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.874007 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.874007 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.874280 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.874410 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.874688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.874862 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.875030 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.875181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.875181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.875546 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.875693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.875693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.875979 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.876116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.876363 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.876533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.876533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.876827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.876984 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.877136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.877283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.877427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.878194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.878440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.878709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.878871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.879037 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.879208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.879382 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.879538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.879685 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.879685 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.879959 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.880109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.880109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.880500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.880653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.880653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.880895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.881054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.881207 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.881352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.881352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.881635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.881792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.881946 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.882108 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.882108 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.882381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.882514 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.882667 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.882923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.883084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.883227 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.883364 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.883509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.883651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.883819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.883819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.884090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.884256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.884421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.884570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.884570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.884856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.884999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.885143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.885300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.885454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.885623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.885623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.885922 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.886150 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.886298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.886463 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.886617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.886778 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.886941 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.887104 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.887249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.887398 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.887529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.887666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.887666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.887983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.888115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.888361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.888574 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.888574 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.888839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.888980 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.889117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.889276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.889276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.889553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.889691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.889838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.889996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.889996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.890261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.890395 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.890563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.890697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.890697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.890978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.891133 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.891278 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.891425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.891567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.891729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.891729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.892007 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.892155 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.892326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.892490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.892490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.892803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.892962 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.893156 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.893318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.893318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.893781 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.893944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.893944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.894240 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.894389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.894547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.894691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.894835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.894979 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.895141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.895288 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.895457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.895618 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.895618 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.895937 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.896165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.896165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.896165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.896165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.896714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.896883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.896883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.897157 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.897308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.897308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.897589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.897751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.897751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.897751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.898151 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.898306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.898306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.898595 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.898745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.898745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.899032 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.899189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.899189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.899189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.899608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.899754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.899754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.900026 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.900194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.900194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.900536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.900699 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.900699 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.900982 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.901142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.901142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.901433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.901579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.901579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.901869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.902029 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.902176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.902331 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.902477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.902627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.902793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.902956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.903119 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.903281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.903281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.903576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.903744 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.903744 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.904034 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.904199 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.904393 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.904561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.904723 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.904869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.905022 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.905178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.905338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.905483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.905648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.905812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.905972 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.906124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.906280 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.906454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.906606 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.906758 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.906916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.907071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.907226 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.907396 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.907546 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.907702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.907856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.908011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.908160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.908420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.908578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.908578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.909403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.909403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.909686 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.909847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.910010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.910179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.910336 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.910494 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.910763 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.910926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.911072 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.911233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.911386 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.911532 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.911693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.911856 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.912008 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.912163 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.912354 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.912520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.912685 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.912845 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.913000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.913152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.913315 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.913477 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.913642 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.913809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.913960 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.914120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.914281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.914425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.914578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.914738 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.914898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.915070 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.915231 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.915386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.915532 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.915697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.915916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.916110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.916361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.916521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.916676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.916827 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.916985 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.917162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.917326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.917477 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.917627 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.917776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.917943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.917943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.918263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.918421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.918582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.918732 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.918909 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.918909 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.919194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.919341 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.919536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.919690 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.919857 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.920002 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.920155 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.920431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.920585 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.920750 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.920910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.921073 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.921220 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.921377 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.921531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.921699 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.921863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.922021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.922171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.922316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.922460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.922617 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.922763 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.922907 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.923064 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.923222 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.923368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.923537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.923537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.923831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.923831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.924115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.924291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.925330 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.925447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.925595 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.925719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.925826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.925981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.926106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.926248 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.926384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.926516 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.926674 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.926811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.926951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.927097 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.927244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.927394 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.927541 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.927710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.927862 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.928005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.928155 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.928349 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.928520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.928685 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.928835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.928995 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.929146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.929295 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.929467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.929467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.929745 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.929745 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.930022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.930182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.930347 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.930505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.930657 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.930803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.930948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.931100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.931266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.931415 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.931562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.931709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.931858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.932003 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.932172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.932347 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.932497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.932645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.932796 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.932796 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.933109 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.933258 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.933410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.933559 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.933718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.933882 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.934034 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.934198 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.934364 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.934514 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.934668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.934836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.934994 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.935144 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.935283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.935283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.935544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.935697 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.935841 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.935970 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.936113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.936113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.936496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.936662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.936819 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.936973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.937136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.937305 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.937481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.937645 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.937645 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.937938 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.938096 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.938258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.938419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.938563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.938716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.938884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.939034 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.939179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.939452 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.939610 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.939764 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.939913 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.940100 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.940302 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.940470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.940616 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.940760 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.940909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.941073 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.941237 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.941392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.941536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.941687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.941860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.942025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.942192 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.942346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.942491 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.942631 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.942784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.942935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.943100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.943250 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.943250 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.943524 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.943669 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.943826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.943973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.944125 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.944369 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.944537 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.944678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.945103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.945270 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.945417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.945562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.945702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.945846 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.946016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.946147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.946287 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.946433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.946593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.946749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.946910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.947062 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.947235 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.947400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.947550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.947718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.947865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.948020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.948186 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.948384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.948543 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.948709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.948866 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.949018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.949181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.949327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.949473 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.949641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.949782 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.949910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.950039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.950179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.950179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.950464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.950659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.950818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.950981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.951141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.951307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.951469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.951625 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.951767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.951918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.951918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.952199 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.952386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.952511 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.952649 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.952781 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.952921 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.953069 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.953224 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.953379 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.953524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.953672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.953826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.953989 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.954147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.954298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.954458 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.954606 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.954765 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.954933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.955105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.955270 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.955426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.955573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.955740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.955861 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.955996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.956141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.956440 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.956573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.956715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.956858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.956994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.957141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.957294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.957455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.957609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.957609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.957884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.958025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.958175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.958328 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.958485 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.958485 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.958749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.958881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.959031 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.959175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.959320 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.959465 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.959609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.959776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.959924 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.960062 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.960201 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.960367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.960506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.960774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.960921 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.961072 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.961236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.961396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.961553 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.961719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.961872 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.962025 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.962173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.962333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.962499 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.962668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.962806 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.962954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.963089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.963243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.963407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.963407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.963706 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.963856 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.964022 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.964183 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.964411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.964411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.964885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.965024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.965177 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.965340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.965506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.965660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.965820 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.965970 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.966129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.966294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.966446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.966592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.966729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.966872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.967022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.967190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.967342 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.967507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.967688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.967846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.967991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.968151 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.968337 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.968481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.968622 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.968776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.968951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.969103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.969256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.969405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.969557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.969709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.969890 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.969890 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.970194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.970411 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.970586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.970733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.970894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.970894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.971735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.971892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.972047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.972210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.972408 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.972567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.972910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.973054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.973189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.973390 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.973557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.973710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.973874 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.974026 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.974178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.974373 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.974529 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.974686 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.974842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.974984 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.975133 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.975298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.975447 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.975608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.975757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.975907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.976074 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.976324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.976472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.976617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.976761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.976909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.977071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.977234 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.977387 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.977551 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.977720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.977874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.978044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.978196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.978350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.978503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.978650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.978808 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.978978 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.979130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.979279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.979424 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.979573 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.979743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.979902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.980045 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.980189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.980363 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.980492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.980696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.980844 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.980981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.981134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.981276 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.981415 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.981578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.981735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.981881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.982025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.982154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.982294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.982294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.982294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.982692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.982832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.982973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.983129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.983270 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.983419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.983566 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.983724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.983869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.984036 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.984197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.984448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.984594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.984739 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.984882 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.985056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.985193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.985324 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.985480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.985623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.985773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.985939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.986100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.986236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.986390 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.986547 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.986714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.986983 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.987645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.987798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.987798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.988085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.988269 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.988432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.988605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.988767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.988923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.989074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.989239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.989389 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.989550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.989702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.989849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.990014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.990159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.990322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.990485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.990485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.990771 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.991048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.991201 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.991349 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.991504 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.991671 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.991861 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.991861 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.991861 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.992381 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.992552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.992729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.992890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.993059 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.993233 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.993388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.993515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.993650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.993815 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.993957 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.994092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.994235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.994390 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.994566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.994718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.994860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.995002 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.995127 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.995263 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.995409 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.995409 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.995684 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.995826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.995973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.996104 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.996338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.996503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.996503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.996793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.996951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.997117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.997282 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.997425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.997425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.997702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.997843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.998009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.998158 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.998318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.998475 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.998614 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.998773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.998936 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.999075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.999218 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.999385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.999548 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.999712 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:48.999878 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.000045 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.000234 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.000407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.000572 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.000725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.000891 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.001049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.001207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.001207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.001502 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.001672 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.001814 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.001950 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.002092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.002254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.002395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.002914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.003075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.003232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.003395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.003545 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.003682 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.003837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.003978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.004130 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.004313 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.004463 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.004648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.004806 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.004960 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.005124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.005282 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.005428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.005591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.005748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.005893 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.006041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.006181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.006328 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.006486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.006629 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.006773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.006915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.007061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.007188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.007352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.007505 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.007505 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.007790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.007938 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.008091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.008268 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.008417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.008582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.008730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.008881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.008881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.008881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.009331 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.009498 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.009666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.009832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.010002 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.010167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.010333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.010523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.010671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.010839 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.011005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.011158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.011309 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.011461 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.011611 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.011772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.011913 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.012060 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.012208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.012484 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.012636 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.012811 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.012961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.013117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.013267 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.013423 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.013576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.013730 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.013933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.014083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.014237 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.014406 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.014567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.014732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.014885 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.015027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.015167 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.015333 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.015564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.015723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.015723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.016002 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.016152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.016632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.016804 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.016962 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.017116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.017116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.017116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.017475 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.017645 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.017795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.017964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.018106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.018654 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.018808 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.018971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.019137 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.019291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.019440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.019589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.019589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.019895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.020060 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.020395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.020573 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.020732 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.020904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.021072 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.021230 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.021381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.021533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.021694 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.021867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.022027 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.022176 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.022324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.022462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.022628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.022781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.022931 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.023083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.023236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.023388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.023655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.023874 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.024061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.024244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.024413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.024570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.024741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.024893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025067 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025532 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 13:55:49.025700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.025700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.026957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.026957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.026957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.026957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.026957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.026957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.026957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.026957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.028099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.028099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.028099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.028099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.028099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.028099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.028099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.028099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.029345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.029345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.029345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.029345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.029345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.029345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.029345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.029345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.030470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.030470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.030470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.030470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.030470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.030470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.030470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.030470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.031652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.031652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.031652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.031652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.031652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.031652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.031652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.032674 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.032674 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.032674 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.033090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.033090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.033382 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.033708 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.034760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.035493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.035835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.036155 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.036572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.036911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.037249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.037583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.037977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.038257 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.038636 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.038959 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.039361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.039708 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.040024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.040408 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.040731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.041067 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.041420 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.041553 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_db.sqlalchemy.engines [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:55:49.041696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.042204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.042493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.042836 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.043261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.044278 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.044278 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.044514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.045002 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.045535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:55:49.045772 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 13:55:49.072535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_db.sqlalchemy.engines [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:55:49.217319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.context [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0356dad4-e903-4b66-9c79-fb26cbe69de2(cell1) {{(pid=107823) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 13:55:49.222379 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:55:49.223928 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:55:49.224798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:55:49.226797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:55:49.239159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_db.sqlalchemy.engines [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:55:49.240048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_db.sqlalchemy.engines [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:55:49.252122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.context [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0356dad4-e903-4b66-9c79-fb26cbe69de2(cell1) {{(pid=107822) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 13:55:49.256629 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:55:49.258281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:55:49.259126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:55:49.261637 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:55:49.275719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_db.sqlalchemy.engines [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:55:49.275719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_db.sqlalchemy.engines [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:55:49.567292 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_db.sqlalchemy.engines [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:55:49.583708 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_db.sqlalchemy.engines [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:55:49.930863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: WARNING keystonemiddleware.auth_token [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:55:49.938232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: WARNING keystonemiddleware.auth_token [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:55:49.952288 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: WARNING keystonemiddleware.auth_token [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:55:49.959977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: WARNING keystonemiddleware.auth_token [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:55:50.307531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: WARNING keystonemiddleware.auth_token [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:55:50.312874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: WARNING keystonemiddleware.auth_token [None req-ecdd1710-d3d9-4b87-afd7-378e15589f94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:55:50.318932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562aabcb79c0 pid: 107822 (default app) Aug 04 13:55:50.327402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: WARNING keystonemiddleware.auth_token [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:55:50.332880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: WARNING keystonemiddleware.auth_token [None req-64ecd06f-4a71-46b7-bd78-296a33ee09ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:55:50.338504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562aabcb79c0 pid: 107823 (default app) Aug 04 13:56:32.096822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1255302718", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "797a83ac-4c81-483e-8472-a4353f133c2c"}]}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:33.874610 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] validate_networks() for [('797a83ac-4c81-483e-8472-a4353f133c2c', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:56:34.538001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-225507418", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "71fdc264-6c79-4112-8159-7717a7075144"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:35.029064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] validate_networks() for [('71fdc264-6c79-4112-8159-7717a7075144', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:56:37.082589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:37.085175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:37.086676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:37.096053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:37.097093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:37.200778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:37.207379 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:37.215204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:37.218765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:37.386876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Getting quotas for project 921c7539fccf48cb818722af29f9c681. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:56:37.402926 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Getting quotas for user ba9483f5dc3e43798cbbf70d55fd5d93 and project 921c7539fccf48cb818722af29f9c681. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:56:37.443896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:56:37.452936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:56:37.757019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2563a24a-e23b-46a5-b75e-00858f81882d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.994689 Aug 04 13:56:37.763555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:56:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 7004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:56:37.786615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c28faca9-6cee-419d-8d81-e64dd7877a7c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:37.787831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c28faca9-6cee-419d-8d81-e64dd7877a7c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:38.337567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c28faca9-6cee-419d-8d81-e64dd7877a7c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:38.403063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c28faca9-6cee-419d-8d81-e64dd7877a7c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1215 microversion: 2.1 time: 0.628623 Aug 04 13:56:38.425652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 2/2] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:37 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1215 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:38.591344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:38.591344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:38.591344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:38.592467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:38.592467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:38.618675 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:38.621417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:38.622546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:38.624791 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:38.719218 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Getting quotas for project 21c2c98b135f4239ab56572ec4a259e1. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:56:38.746005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Getting quotas for user f19e6144804c449586614d68ec2abe7b and project 21c2c98b135f4239ab56572ec4a259e1. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:56:38.774480 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:56:38.781533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:56:38.996034 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2bae24ba-aca1-493e-afb3-41eb38c48d98 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.059006 Aug 04 13:56:39.011417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:56:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 5065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:56:39.020656 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b02f1e03-0d56-4054-a729-aacd52415e1b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:39.021811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b02f1e03-0d56-4054-a729-aacd52415e1b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:39.438776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bcfe1b26-8547-4a3a-b03f-119dcd236a46 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:39.439888 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bcfe1b26-8547-4a3a-b03f-119dcd236a46 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:39.477313 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b02f1e03-0d56-4054-a729-aacd52415e1b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.485732 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b02f1e03-0d56-4054-a729-aacd52415e1b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1217 microversion: 2.1 time: 0.472711 Aug 04 13:56:39.492040 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 3/4] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:39 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1217 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:40.511716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f421b48a-c12c-4180-a4ad-66d37c1d748f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:40.512876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f421b48a-c12c-4180-a4ad-66d37c1d748f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:40.616432 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bcfe1b26-8547-4a3a-b03f-119dcd236a46 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:40.644801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bcfe1b26-8547-4a3a-b03f-119dcd236a46 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1215 microversion: 2.1 time: 1.214195 Aug 04 13:56:40.646172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 2/5] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:39 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1215 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:40.804855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f421b48a-c12c-4180-a4ad-66d37c1d748f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:40.839469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f421b48a-c12c-4180-a4ad-66d37c1d748f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1217 microversion: 2.1 time: 0.335575 Aug 04 13:56:40.847433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 4/6] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:40 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1217 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:41.673088 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a877ba56-52f3-4fa2-9493-722a1dd808b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:41.675997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a877ba56-52f3-4fa2-9493-722a1dd808b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:41.699621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a877ba56-52f3-4fa2-9493-722a1dd808b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:41.700011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a877ba56-52f3-4fa2-9493-722a1dd808b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:41.700896 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a877ba56-52f3-4fa2-9493-722a1dd808b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:41.701647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a877ba56-52f3-4fa2-9493-722a1dd808b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:41.875477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-20796f3f-aaae-497a-a869-ee4f6f8d6bce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:41.882362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-20796f3f-aaae-497a-a869-ee4f6f8d6bce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:41.914863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-20796f3f-aaae-497a-a869-ee4f6f8d6bce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:41.915339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-20796f3f-aaae-497a-a869-ee4f6f8d6bce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:41.925049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-20796f3f-aaae-497a-a869-ee4f6f8d6bce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:41.925651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-20796f3f-aaae-497a-a869-ee4f6f8d6bce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:42.488659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a877ba56-52f3-4fa2-9493-722a1dd808b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:42.574506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a877ba56-52f3-4fa2-9493-722a1dd808b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1211 microversion: 2.1 time: 0.905973 Aug 04 13:56:42.581944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 3/7] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:41 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1211 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:42.707529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-20796f3f-aaae-497a-a869-ee4f6f8d6bce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:42.761234 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-20796f3f-aaae-497a-a869-ee4f6f8d6bce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1213 microversion: 2.1 time: 0.897423 Aug 04 13:56:42.766212 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:41 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1213 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:43.606521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-dc79c741-b271-401f-be1c-0b58b4614d1c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:43.607963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-dc79c741-b271-401f-be1c-0b58b4614d1c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:43.619226 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc79c741-b271-401f-be1c-0b58b4614d1c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:43.619946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc79c741-b271-401f-be1c-0b58b4614d1c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:43.621697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc79c741-b271-401f-be1c-0b58b4614d1c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:43.623181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc79c741-b271-401f-be1c-0b58b4614d1c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:43.801620 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f6fe7700-d9a0-4df3-b506-54363eb539c7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:43.802983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f6fe7700-d9a0-4df3-b506-54363eb539c7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:43.823904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f6fe7700-d9a0-4df3-b506-54363eb539c7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:43.827004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f6fe7700-d9a0-4df3-b506-54363eb539c7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:43.832468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f6fe7700-d9a0-4df3-b506-54363eb539c7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:43.834028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f6fe7700-d9a0-4df3-b506-54363eb539c7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:43.900148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-dc79c741-b271-401f-be1c-0b58b4614d1c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:43.931426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-dc79c741-b271-401f-be1c-0b58b4614d1c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1273 microversion: 2.1 time: 0.329259 Aug 04 13:56:43.949702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 4/9] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:43 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:45.093594 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-909934955", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26636b3c-7bb3-4398-b73e-a4dab88c31c9"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:45.474821 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] validate_networks() for [('26636b3c-7bb3-4398-b73e-a4dab88c31c9', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:56:45.594907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f6fe7700-d9a0-4df3-b506-54363eb539c7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:45.611467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f6fe7700-d9a0-4df3-b506-54363eb539c7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1275 microversion: 2.1 time: 1.821995 Aug 04 13:56:45.618056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 6/10] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:43 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1275 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:45.640854 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-151639c9-ccf4-4d97-b55c-2cceac1795ed tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:45.643205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-151639c9-ccf4-4d97-b55c-2cceac1795ed tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:45.670376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-151639c9-ccf4-4d97-b55c-2cceac1795ed tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:45.678106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-151639c9-ccf4-4d97-b55c-2cceac1795ed tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:45.689493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-151639c9-ccf4-4d97-b55c-2cceac1795ed tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:45.691273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-151639c9-ccf4-4d97-b55c-2cceac1795ed tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:46.196435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-151639c9-ccf4-4d97-b55c-2cceac1795ed tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:46.264173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-151639c9-ccf4-4d97-b55c-2cceac1795ed tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1273 microversion: 2.1 time: 0.643024 Aug 04 13:56:46.272821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 7/11] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:45 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1273 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:46.640127 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-75f76860-481c-4f33-bdac-b6e0bb921328 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:46.646102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-75f76860-481c-4f33-bdac-b6e0bb921328 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:46.712149 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75f76860-481c-4f33-bdac-b6e0bb921328 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:46.713204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75f76860-481c-4f33-bdac-b6e0bb921328 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:46.714886 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75f76860-481c-4f33-bdac-b6e0bb921328 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:46.715802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75f76860-481c-4f33-bdac-b6e0bb921328 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:47.834927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-75f76860-481c-4f33-bdac-b6e0bb921328 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:47.874366 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-75f76860-481c-4f33-bdac-b6e0bb921328 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1275 microversion: 2.1 time: 1.239917 Aug 04 13:56:47.878901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 8/12] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:46 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1275 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:47.899103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f4a77f1c-9418-4dca-bc41-5476ffb04dad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:47.901789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f4a77f1c-9418-4dca-bc41-5476ffb04dad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:47.929318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f4a77f1c-9418-4dca-bc41-5476ffb04dad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:47.936671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f4a77f1c-9418-4dca-bc41-5476ffb04dad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:47.947743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f4a77f1c-9418-4dca-bc41-5476ffb04dad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:47.948839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f4a77f1c-9418-4dca-bc41-5476ffb04dad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:48.394671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f4a77f1c-9418-4dca-bc41-5476ffb04dad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:48.394671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f4a77f1c-9418-4dca-bc41-5476ffb04dad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1273 microversion: 2.1 time: 0.504786 Aug 04 13:56:48.397093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 9/13] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:47 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1273 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:48.898702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c9a009d0-8c71-4e6d-8503-260bfb525cd6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:48.899751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c9a009d0-8c71-4e6d-8503-260bfb525cd6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:48.938460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c9a009d0-8c71-4e6d-8503-260bfb525cd6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:48.939255 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c9a009d0-8c71-4e6d-8503-260bfb525cd6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:48.950042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c9a009d0-8c71-4e6d-8503-260bfb525cd6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:48.950959 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c9a009d0-8c71-4e6d-8503-260bfb525cd6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:49.514505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c9a009d0-8c71-4e6d-8503-260bfb525cd6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.531087 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c9a009d0-8c71-4e6d-8503-260bfb525cd6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1275 microversion: 2.1 time: 0.639209 Aug 04 13:56:49.547075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 10/14] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:48 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1275 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:49.607898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1405909b-8e22-420d-9d47-12e5ac088ad5 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:49.609259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1405909b-8e22-420d-9d47-12e5ac088ad5 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:49.657105 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1405909b-8e22-420d-9d47-12e5ac088ad5 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:49.669576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1405909b-8e22-420d-9d47-12e5ac088ad5 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:49.678942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1405909b-8e22-420d-9d47-12e5ac088ad5 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:49.688078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1405909b-8e22-420d-9d47-12e5ac088ad5 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:50.053955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1405909b-8e22-420d-9d47-12e5ac088ad5 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:50.092577 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1405909b-8e22-420d-9d47-12e5ac088ad5 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1273 microversion: 2.1 time: 0.520170 Aug 04 13:56:50.101182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 11/15] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:49 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1273 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:50.562334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f2017fcd-7cf1-469a-8da2-fea39ef9e5e3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:50.563377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f2017fcd-7cf1-469a-8da2-fea39ef9e5e3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:50.591003 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f2017fcd-7cf1-469a-8da2-fea39ef9e5e3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:50.594564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f2017fcd-7cf1-469a-8da2-fea39ef9e5e3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:50.599634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f2017fcd-7cf1-469a-8da2-fea39ef9e5e3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:50.601924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f2017fcd-7cf1-469a-8da2-fea39ef9e5e3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:51.425979 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:51.427761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:51.429041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:51.430024 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:51.432425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:51.460312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:51.461591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:51.463647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:51.464837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:51.546072 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Getting quotas for project 8c0454d3b2b844899064bc25b77f5fb3. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:56:51.561297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Getting quotas for user ce48ac6eb6434638a63ff06cc22c18e8 and project 8c0454d3b2b844899064bc25b77f5fb3. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:56:51.620804 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:56:51.627041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:56:51.949404 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e3279cff-44b2-4867-a908-6a8b1df886e8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.762501 Aug 04 13:56:51.959509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 5/16] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:56:44 2021] POST /compute/v2.1/servers => generated 383 bytes in 7777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 13:56:51.996103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ae896ae4-cb57-48ce-9bfc-7621f46f6e5e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:51.997935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ae896ae4-cb57-48ce-9bfc-7621f46f6e5e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:52.056535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ae896ae4-cb57-48ce-9bfc-7621f46f6e5e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:52.068718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ae896ae4-cb57-48ce-9bfc-7621f46f6e5e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:52.084370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ae896ae4-cb57-48ce-9bfc-7621f46f6e5e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:52.085549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ae896ae4-cb57-48ce-9bfc-7621f46f6e5e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:53.249826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f2017fcd-7cf1-469a-8da2-fea39ef9e5e3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.265378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f2017fcd-7cf1-469a-8da2-fea39ef9e5e3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 2.713468 Aug 04 13:56:53.265993 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 12/17] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:50 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:53.274927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-625b2c38-6663-4536-bc75-0b9c26bde779 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:53.291459 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-625b2c38-6663-4536-bc75-0b9c26bde779 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:53.823286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-625b2c38-6663-4536-bc75-0b9c26bde779 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.843632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-625b2c38-6663-4536-bc75-0b9c26bde779 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1221 microversion: 2.1 time: 0.572010 Aug 04 13:56:53.849519 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 13/18] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:53 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1221 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:53.888239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ae896ae4-cb57-48ce-9bfc-7621f46f6e5e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.919994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ae896ae4-cb57-48ce-9bfc-7621f46f6e5e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 1.953431 Aug 04 13:56:53.921087 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 6/19] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:51 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:54.185514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2093399876", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26636b3c-7bb3-4398-b73e-a4dab88c31c9"}]}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:54.305757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bf6f2347-3479-4b8c-bcc4-432340dcc502 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:54.310990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bf6f2347-3479-4b8c-bcc4-432340dcc502 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:54.332835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bf6f2347-3479-4b8c-bcc4-432340dcc502 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:54.333471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bf6f2347-3479-4b8c-bcc4-432340dcc502 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:54.337494 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bf6f2347-3479-4b8c-bcc4-432340dcc502 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:54.337947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bf6f2347-3479-4b8c-bcc4-432340dcc502 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:55.118228 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bf6f2347-3479-4b8c-bcc4-432340dcc502 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:55.133355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bf6f2347-3479-4b8c-bcc4-432340dcc502 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.840644 Aug 04 13:56:55.134000 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 7/20] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:54 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:55.154085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e7d5e03b-f309-4ef1-b608-105abb801d3b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:55.154741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e7d5e03b-f309-4ef1-b608-105abb801d3b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:55.176552 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e7d5e03b-f309-4ef1-b608-105abb801d3b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:55.179686 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e7d5e03b-f309-4ef1-b608-105abb801d3b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:55.184667 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e7d5e03b-f309-4ef1-b608-105abb801d3b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:55.185218 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e7d5e03b-f309-4ef1-b608-105abb801d3b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:56.760018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e7d5e03b-f309-4ef1-b608-105abb801d3b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:56.795771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e7d5e03b-f309-4ef1-b608-105abb801d3b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 1.638786 Aug 04 13:56:56.809503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 8/21] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:55 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:57.304680 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6c144882-d975-4dd5-b94b-4ecd0df129c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'create', calling method: .version_select at 0x7efe7d8431f0>, body: {"keypair": {"name": "tempest-keypair-913144320"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:57.500811 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-6c144882-d975-4dd5-b94b-4ecd0df129c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for project 072954af44a647e3a037f30f2ac7f27b. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:56:57.540354 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-6c144882-d975-4dd5-b94b-4ecd0df129c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for user 034d5f53aa544eb88d4522dea7b428ff and project 072954af44a647e3a037f30f2ac7f27b. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:56:58.695040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-6c144882-d975-4dd5-b94b-4ecd0df129c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for project 072954af44a647e3a037f30f2ac7f27b. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:56:58.700158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-6c144882-d975-4dd5-b94b-4ecd0df129c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for user 034d5f53aa544eb88d4522dea7b428ff and project 072954af44a647e3a037f30f2ac7f27b. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:56:58.750101 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6c144882-d975-4dd5-b94b-4ecd0df129c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.938769 Aug 04 13:56:58.753117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 9/22] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Aug 4 13:56:56 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1943 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 04 13:56:58.768287 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e40425ad-81a2-453c-8225-d8dd8d2c0fe2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:58.769057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e40425ad-81a2-453c-8225-d8dd8d2c0fe2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:56:58.792530 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e40425ad-81a2-453c-8225-d8dd8d2c0fe2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:58.793293 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e40425ad-81a2-453c-8225-d8dd8d2c0fe2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:56:58.801278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e40425ad-81a2-453c-8225-d8dd8d2c0fe2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:56:58.803501 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e40425ad-81a2-453c-8225-d8dd8d2c0fe2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:00.238334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e40425ad-81a2-453c-8225-d8dd8d2c0fe2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:00.251943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e40425ad-81a2-453c-8225-d8dd8d2c0fe2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 1.497594 Aug 04 13:57:00.267558 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 10/23] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:56:58 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:00.468902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-a39cdf60-ac33-42d5-a468-870f84d479ad req-2fb2c084-29d8-40da-82b7-6bb5014785a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5393f6f8-d997-4def-9ada-9df175d346be", "tag": "7e794fec-4d42-4e16-a581-d3659230bffe"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:00.472306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:00.472306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:57:00.497518 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-a39cdf60-ac33-42d5-a468-870f84d479ad req-2fb2c084-29d8-40da-82b7-6bb5014785a3 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:00.503931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-a39cdf60-ac33-42d5-a468-870f84d479ad req-2fb2c084-29d8-40da-82b7-6bb5014785a3 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:00.566040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-a39cdf60-ac33-42d5-a468-870f84d479ad req-2fb2c084-29d8-40da-82b7-6bb5014785a3 service nova] Creating event network-changed:7e794fec-4d42-4e16-a581-d3659230bffe for instance 5393f6f8-d997-4def-9ada-9df175d346be on hv-cinder-79264 Aug 04 13:57:00.568999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-a39cdf60-ac33-42d5-a468-870f84d479ad req-2fb2c084-29d8-40da-82b7-6bb5014785a3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107823) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 04 13:57:00.570947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0532b2d-e419-4762-ae3b-58bdb2efd41b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:00.572648 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0532b2d-e419-4762-ae3b-58bdb2efd41b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:00.575237 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0532b2d-e419-4762-ae3b-58bdb2efd41b None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:00.593777 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0532b2d-e419-4762-ae3b-58bdb2efd41b None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:00.657080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.compute.rpcapi [None req-f0532b2d-e419-4762-ae3b-58bdb2efd41b None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 04 13:57:00.684776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0532b2d-e419-4762-ae3b-58bdb2efd41b None None] Releasing lock "compute-rpcapi-router" {{(pid=107823) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 04 13:57:00.792566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f0532b2d-e419-4762-ae3b-58bdb2efd41b None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522900 Aug 04 13:57:00.793711 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 11/24] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:00.813525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b8fad3c6-f447-43d3-ac15-e6e2d3e0336f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:00.819787 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b8fad3c6-f447-43d3-ac15-e6e2d3e0336f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:00.846964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b8fad3c6-f447-43d3-ac15-e6e2d3e0336f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:00.847780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b8fad3c6-f447-43d3-ac15-e6e2d3e0336f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:00.848943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b8fad3c6-f447-43d3-ac15-e6e2d3e0336f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:00.849592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b8fad3c6-f447-43d3-ac15-e6e2d3e0336f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:02.513749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b8fad3c6-f447-43d3-ac15-e6e2d3e0336f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:02.543054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b8fad3c6-f447-43d3-ac15-e6e2d3e0336f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 1.745571 Aug 04 13:57:02.544125 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:00 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:02.558191 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1e246498-cf3f-488b-97c1-5958a5f140f5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:02.568801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1e246498-cf3f-488b-97c1-5958a5f140f5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:02.592117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e246498-cf3f-488b-97c1-5958a5f140f5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:02.592729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e246498-cf3f-488b-97c1-5958a5f140f5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:02.593636 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e246498-cf3f-488b-97c1-5958a5f140f5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:02.596102 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e246498-cf3f-488b-97c1-5958a5f140f5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:03.479631 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1e246498-cf3f-488b-97c1-5958a5f140f5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:03.499351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1e246498-cf3f-488b-97c1-5958a5f140f5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.945322 Aug 04 13:57:03.500852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 13/26] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:02 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:03.743733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] validate_networks() for [('26636b3c-7bb3-4398-b73e-a4dab88c31c9', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:57:03.878621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-d2b1634d-c554-4104-b116-b6f8c8a59ebe req-ebc94ac6-084d-4ac6-8fc4-08ccb4ded057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9793c85c-8440-4767-a627-2ff4c2c559a2", "tag": "33fe8983-4030-4984-8c31-c7cfa77508c5"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:03.881639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:03.881639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:57:03.893568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-d2b1634d-c554-4104-b116-b6f8c8a59ebe req-ebc94ac6-084d-4ac6-8fc4-08ccb4ded057 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:03.894479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-d2b1634d-c554-4104-b116-b6f8c8a59ebe req-ebc94ac6-084d-4ac6-8fc4-08ccb4ded057 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:03.916829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-d2b1634d-c554-4104-b116-b6f8c8a59ebe req-ebc94ac6-084d-4ac6-8fc4-08ccb4ded057 service nova] Creating event network-changed:33fe8983-4030-4984-8c31-c7cfa77508c5 for instance 9793c85c-8440-4767-a627-2ff4c2c559a2 on hv-cinder-79264 Aug 04 13:57:03.928209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-d2b1634d-c554-4104-b116-b6f8c8a59ebe req-ebc94ac6-084d-4ac6-8fc4-08ccb4ded057 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411619 Aug 04 13:57:03.929702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 14/27] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:03.940707 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-17e8274d-7204-4df0-b40f-89bc29c8654a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:03.941881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-17e8274d-7204-4df0-b40f-89bc29c8654a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:03.952626 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17e8274d-7204-4df0-b40f-89bc29c8654a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:03.953665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17e8274d-7204-4df0-b40f-89bc29c8654a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:03.955327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17e8274d-7204-4df0-b40f-89bc29c8654a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:03.956121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17e8274d-7204-4df0-b40f-89bc29c8654a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:04.342606 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-17e8274d-7204-4df0-b40f-89bc29c8654a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:04.357586 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-17e8274d-7204-4df0-b40f-89bc29c8654a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.425278 Aug 04 13:57:04.360006 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:03 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:04.520509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-71f0c869-ecbd-41c6-b872-0d1e2cfb87af tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:04.521375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-71f0c869-ecbd-41c6-b872-0d1e2cfb87af tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:04.531180 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71f0c869-ecbd-41c6-b872-0d1e2cfb87af tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:04.531901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71f0c869-ecbd-41c6-b872-0d1e2cfb87af tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:04.533796 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71f0c869-ecbd-41c6-b872-0d1e2cfb87af tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:04.534678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71f0c869-ecbd-41c6-b872-0d1e2cfb87af tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:04.824985 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-71f0c869-ecbd-41c6-b872-0d1e2cfb87af tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:04.843213 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-71f0c869-ecbd-41c6-b872-0d1e2cfb87af tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.328434 Aug 04 13:57:04.844397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 16/29] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:04 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:05.245482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:57:05.246427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:57:05.247463 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:57:05.248322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:57:05.249594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:57:05.270811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:05.271613 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:05.273597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:05.274377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:05.358891 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Getting quotas for project 8c0454d3b2b844899064bc25b77f5fb3. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:57:05.385142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2dea6e15-2584-4ee8-a1af-8db85aa3c3e9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:05.387110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2dea6e15-2584-4ee8-a1af-8db85aa3c3e9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:05.394145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Getting quotas for user ce48ac6eb6434638a63ff06cc22c18e8 and project 8c0454d3b2b844899064bc25b77f5fb3. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:57:05.408137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2dea6e15-2584-4ee8-a1af-8db85aa3c3e9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:05.413319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2dea6e15-2584-4ee8-a1af-8db85aa3c3e9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:05.414875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2dea6e15-2584-4ee8-a1af-8db85aa3c3e9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:05.416129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2dea6e15-2584-4ee8-a1af-8db85aa3c3e9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:05.426007 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:57:05.431384 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:57:05.529629 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d4bc561c-751e-430a-9e67-cf5d3b350719 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 11.348500 Aug 04 13:57:05.540487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 14/30] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:56:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 11359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:57:05.545672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0d6f1d38-a9fc-41a5-b78f-503119459499 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:05.551475 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0d6f1d38-a9fc-41a5-b78f-503119459499 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:05.632393 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0d6f1d38-a9fc-41a5-b78f-503119459499 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:05.650042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0d6f1d38-a9fc-41a5-b78f-503119459499 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1222 microversion: 2.1 time: 0.098404 Aug 04 13:57:05.661984 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 15/31] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:05 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:05.850990 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bdb870fe-4d48-472b-82ba-154ca88f66a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'create', calling method: .version_select at 0x7efe7d8f2ee0>, body: {"keypair": {"name": "tempest-keypair-1381021727"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:05.988122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-bdb870fe-4d48-472b-82ba-154ca88f66a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:57:05.996715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-bdb870fe-4d48-472b-82ba-154ca88f66a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for user b9c2439b760c4abaa9cd6a43408bf092 and project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:57:06.083555 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2dea6e15-2584-4ee8-a1af-8db85aa3c3e9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:06.097077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2dea6e15-2584-4ee8-a1af-8db85aa3c3e9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.716330 Aug 04 13:57:06.098560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 17/32] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:05 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:06.106665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a66002bb-93cd-473c-b8cf-7b3f7e04a17f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:06.107941 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a66002bb-93cd-473c-b8cf-7b3f7e04a17f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:06.118370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a66002bb-93cd-473c-b8cf-7b3f7e04a17f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:06.119283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a66002bb-93cd-473c-b8cf-7b3f7e04a17f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:06.121030 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a66002bb-93cd-473c-b8cf-7b3f7e04a17f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:06.121835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a66002bb-93cd-473c-b8cf-7b3f7e04a17f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:06.379211 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a66002bb-93cd-473c-b8cf-7b3f7e04a17f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:06.396779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a66002bb-93cd-473c-b8cf-7b3f7e04a17f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.295809 Aug 04 13:57:06.408207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 18/33] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:06 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:06.431116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-bdb870fe-4d48-472b-82ba-154ca88f66a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:57:06.437007 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-6e6d3165-80c1-41f0-bd1d-3a0595b8b5bf req-8c30dff6-d499-49bd-aeb5-10c4c8557dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee769da-062a-4fe8-bd70-3dce1f031665", "tag": "cca51760-a38b-4efa-be59-cfcd9a84171a"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:06.441339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-bdb870fe-4d48-472b-82ba-154ca88f66a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for user b9c2439b760c4abaa9cd6a43408bf092 and project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:57:06.450041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:06.450041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:57:06.468646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bdb870fe-4d48-472b-82ba-154ca88f66a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.803070 Aug 04 13:57:06.477531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 16/34] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Aug 4 13:57:05 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:06.478610 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-6e6d3165-80c1-41f0-bd1d-3a0595b8b5bf req-8c30dff6-d499-49bd-aeb5-10c4c8557dcc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:06.479066 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-6e6d3165-80c1-41f0-bd1d-3a0595b8b5bf req-8c30dff6-d499-49bd-aeb5-10c4c8557dcc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:06.515273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1938238276", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa54aa9e-68db-4c4a-a20b-885452226b74"}], "security_groups": [{"name": "tempest-securitygroup--501781886"}], "key_name": "tempest-keypair-913144320", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:06.533109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-6e6d3165-80c1-41f0-bd1d-3a0595b8b5bf req-8c30dff6-d499-49bd-aeb5-10c4c8557dcc service nova] Creating event network-changed:cca51760-a38b-4efa-be59-cfcd9a84171a for instance 7ee769da-062a-4fe8-bd70-3dce1f031665 on hv-cinder-79264 Aug 04 13:57:06.541009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-6e6d3165-80c1-41f0-bd1d-3a0595b8b5bf req-8c30dff6-d499-49bd-aeb5-10c4c8557dcc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130660 Aug 04 13:57:06.542579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 19/35] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:06.669769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-87ad795e-fcd1-42d1-bad0-5aba1f0aecdb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:06.670776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-87ad795e-fcd1-42d1-bad0-5aba1f0aecdb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:06.690065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-87ad795e-fcd1-42d1-bad0-5aba1f0aecdb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:06.693388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-87ad795e-fcd1-42d1-bad0-5aba1f0aecdb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:06.695863 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-87ad795e-fcd1-42d1-bad0-5aba1f0aecdb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:06.696777 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-87ad795e-fcd1-42d1-bad0-5aba1f0aecdb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:06.722252 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] validate_networks() for [('fa54aa9e-68db-4c4a-a20b-885452226b74', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:57:06.863410 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-87ad795e-fcd1-42d1-bad0-5aba1f0aecdb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:06.872099 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-87ad795e-fcd1-42d1-bad0-5aba1f0aecdb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1226 microversion: 2.1 time: 0.206569 Aug 04 13:57:06.873381 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 20/36] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:06 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1226 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:07.115300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-25c3e68f-e106-475e-a61a-1f62056f5b1d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:07.115935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-25c3e68f-e106-475e-a61a-1f62056f5b1d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:07.131279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25c3e68f-e106-475e-a61a-1f62056f5b1d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:07.138172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25c3e68f-e106-475e-a61a-1f62056f5b1d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:07.139226 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25c3e68f-e106-475e-a61a-1f62056f5b1d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:07.139690 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25c3e68f-e106-475e-a61a-1f62056f5b1d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:07.651129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-25c3e68f-e106-475e-a61a-1f62056f5b1d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:07.685885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-25c3e68f-e106-475e-a61a-1f62056f5b1d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.565748 Aug 04 13:57:07.695102 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 21/37] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:07 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:07.746007 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e96b97a1-5f5d-4c41-b34f-7a77e81f90e1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:07.747334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e96b97a1-5f5d-4c41-b34f-7a77e81f90e1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:07.761717 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e96b97a1-5f5d-4c41-b34f-7a77e81f90e1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:07.767243 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e96b97a1-5f5d-4c41-b34f-7a77e81f90e1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:07.774714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e96b97a1-5f5d-4c41-b34f-7a77e81f90e1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:07.775525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e96b97a1-5f5d-4c41-b34f-7a77e81f90e1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:07.820852 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:57:07.822514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:57:07.823651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:57:07.824671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:57:07.825645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:57:07.845194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:07.846533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:07.848839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:07.850006 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:07.909480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for project 072954af44a647e3a037f30f2ac7f27b. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:57:07.921257 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for user 034d5f53aa544eb88d4522dea7b428ff and project 072954af44a647e3a037f30f2ac7f27b. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:57:07.973678 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:57:07.982114 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:57:08.155818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c0128365-0de4-40d4-a50e-0547d5ad733d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.681433 Aug 04 13:57:08.157435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 17/38] 10.222.0.43 () {62 vars in 1188 bytes} [Wed Aug 4 13:57:06 2021] POST /compute/v2.1/servers => generated 401 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 13:57:08.162648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bb15c022-64ad-4f97-9dc2-8c6b4b4f424f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:08.164799 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bb15c022-64ad-4f97-9dc2-8c6b4b4f424f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:08.176741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bb15c022-64ad-4f97-9dc2-8c6b4b4f424f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:08.179053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bb15c022-64ad-4f97-9dc2-8c6b4b4f424f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:08.180341 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bb15c022-64ad-4f97-9dc2-8c6b4b4f424f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:08.181357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bb15c022-64ad-4f97-9dc2-8c6b4b4f424f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:08.278355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e96b97a1-5f5d-4c41-b34f-7a77e81f90e1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:08.299164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e96b97a1-5f5d-4c41-b34f-7a77e81f90e1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.597749 Aug 04 13:57:08.317863 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 22/39] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:07 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:08.338888 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-60f4fbe2-aa0b-484a-a7b5-694fe3e869d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:08.342355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-60f4fbe2-aa0b-484a-a7b5-694fe3e869d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:08.373112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bb15c022-64ad-4f97-9dc2-8c6b4b4f424f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:08.397827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bb15c022-64ad-4f97-9dc2-8c6b4b4f424f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1226 microversion: 2.1 time: 0.238607 Aug 04 13:57:08.399534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 18/40] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:08 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1226 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:08.494054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-60f4fbe2-aa0b-484a-a7b5-694fe3e869d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:08.507026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-60f4fbe2-aa0b-484a-a7b5-694fe3e869d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:08.510594 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-60f4fbe2-aa0b-484a-a7b5-694fe3e869d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:08.512965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-60f4fbe2-aa0b-484a-a7b5-694fe3e869d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1281 microversion: 2.20 time: 0.192755 Aug 04 13:57:08.526348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 23/41] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:08 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:08.724246 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e40d657a-c34b-42b4-b125-edf3bdb6ed86 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:08.725331 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e40d657a-c34b-42b4-b125-edf3bdb6ed86 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:08.735004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e40d657a-c34b-42b4-b125-edf3bdb6ed86 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:08.736354 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e40d657a-c34b-42b4-b125-edf3bdb6ed86 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:08.737901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e40d657a-c34b-42b4-b125-edf3bdb6ed86 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:08.738526 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e40d657a-c34b-42b4-b125-edf3bdb6ed86 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:09.089679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e40d657a-c34b-42b4-b125-edf3bdb6ed86 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:09.117232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e40d657a-c34b-42b4-b125-edf3bdb6ed86 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.398030 Aug 04 13:57:09.118334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 19/42] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:08 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:09.355922 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8c83e9ec-ce2e-4261-a9e0-4ed88b589211 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:09.363351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8c83e9ec-ce2e-4261-a9e0-4ed88b589211 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:09.387057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c83e9ec-ce2e-4261-a9e0-4ed88b589211 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:09.388015 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c83e9ec-ce2e-4261-a9e0-4ed88b589211 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:09.389676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c83e9ec-ce2e-4261-a9e0-4ed88b589211 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:09.390622 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c83e9ec-ce2e-4261-a9e0-4ed88b589211 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:09.427599 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e9649561-8dee-4076-919e-7fed187f4023 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:09.434760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e9649561-8dee-4076-919e-7fed187f4023 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:09.479179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e9649561-8dee-4076-919e-7fed187f4023 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:09.479982 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e9649561-8dee-4076-919e-7fed187f4023 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:09.492373 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e9649561-8dee-4076-919e-7fed187f4023 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:09.493408 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e9649561-8dee-4076-919e-7fed187f4023 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:09.820303 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e9649561-8dee-4076-919e-7fed187f4023 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:09.857954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8c83e9ec-ce2e-4261-a9e0-4ed88b589211 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:09.869068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8c83e9ec-ce2e-4261-a9e0-4ed88b589211 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.540416 Aug 04 13:57:09.869688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 24/43] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:09 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:09.888867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e9649561-8dee-4076-919e-7fed187f4023 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1226 microversion: 2.1 time: 0.430086 Aug 04 13:57:09.893747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 20/44] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:09 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1226 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:09.894006 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:09.894452 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:09.921460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:09.921919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:09.922869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:09.930674 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:10.119115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.143004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-29ef3f14-622d-4b5b-ad2a-0b0125567200 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:10.144589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-29ef3f14-622d-4b5b-ad2a-0b0125567200 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:10.156066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-29ef3f14-622d-4b5b-ad2a-0b0125567200 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:10.159378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-29ef3f14-622d-4b5b-ad2a-0b0125567200 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:10.163818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-29ef3f14-622d-4b5b-ad2a-0b0125567200 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:10.165194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-29ef3f14-622d-4b5b-ad2a-0b0125567200 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:10.173487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.184188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.205541 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-29158194-a281-4874-850d-2d9d97ccf46e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1285 microversion: 2.20 time: 0.331169 Aug 04 13:57:10.209980 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 25/45] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:09 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1285 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:10.372527 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2143757751", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0081e9f6-4973-4c5d-a223-86c0d7d78ed7"}], "security_groups": [{"name": "tempest-securitygroup--1624420682"}], "key_name": "tempest-keypair-1381021727", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:10.550449 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] validate_networks() for [('0081e9f6-4973-4c5d-a223-86c0d7d78ed7', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:57:10.558339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-29ef3f14-622d-4b5b-ad2a-0b0125567200 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.581817 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-29ef3f14-622d-4b5b-ad2a-0b0125567200 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.450091 Aug 04 13:57:10.583899 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 21/46] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:10 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:10.903557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8a73410e-128b-4314-9fd8-a07bf1be3fe7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:10.904190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8a73410e-128b-4314-9fd8-a07bf1be3fe7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:10.911264 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a73410e-128b-4314-9fd8-a07bf1be3fe7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:10.911950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a73410e-128b-4314-9fd8-a07bf1be3fe7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:10.912715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a73410e-128b-4314-9fd8-a07bf1be3fe7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:10.913293 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a73410e-128b-4314-9fd8-a07bf1be3fe7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.182656 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8a73410e-128b-4314-9fd8-a07bf1be3fe7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.192553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8a73410e-128b-4314-9fd8-a07bf1be3fe7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.297806 Aug 04 13:57:11.193208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 22/47] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:10 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:11.198994 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a6c0c2ec-db0f-44ea-b821-ff31fe9fa21d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:11.215714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a6c0c2ec-db0f-44ea-b821-ff31fe9fa21d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:11.231436 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6c0c2ec-db0f-44ea-b821-ff31fe9fa21d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:11.232124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6c0c2ec-db0f-44ea-b821-ff31fe9fa21d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.246759 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6c0c2ec-db0f-44ea-b821-ff31fe9fa21d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:11.247551 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6c0c2ec-db0f-44ea-b821-ff31fe9fa21d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.442603 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:57:11.443119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:57:11.443789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:57:11.444457 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:57:11.445065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:57:11.475608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:11.476090 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.477061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:11.477505 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.538766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:57:11.543763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for user b9c2439b760c4abaa9cd6a43408bf092 and project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:57:11.574866 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:57:11.585904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:57:11.598732 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a6c0c2ec-db0f-44ea-b821-ff31fe9fa21d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.628698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a6c0c2ec-db0f-44ea-b821-ff31fe9fa21d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1226 microversion: 2.1 time: 0.414020 Aug 04 13:57:11.629386 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 23/48] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:11 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1226 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:11.642912 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:11.643523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:11.662614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:11.663057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.667586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:11.670079 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.760789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-37bc91ab-98b8-4865-91ec-8e1e11f3b4b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.392574 Aug 04 13:57:11.762138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 26/49] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:57:10 2021] POST /compute/v2.1/servers => generated 402 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:57:11.769052 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4716ec44-06c6-4dbe-b9ed-5daff9594259 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:11.769973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4716ec44-06c6-4dbe-b9ed-5daff9594259 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:11.777925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4716ec44-06c6-4dbe-b9ed-5daff9594259 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:11.778902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4716ec44-06c6-4dbe-b9ed-5daff9594259 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.779958 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4716ec44-06c6-4dbe-b9ed-5daff9594259 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:11.780636 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4716ec44-06c6-4dbe-b9ed-5daff9594259 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:11.918361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.932160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.939850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.941614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7e35beb1-5bc3-4e51-8606-dd70114a46c3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1277 microversion: 2.20 time: 0.302464 Aug 04 13:57:11.945061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 24/50] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:11 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:11.957874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1e1addac-e18f-4d93-aac3-c162fc304ef2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:11.964488 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1e1addac-e18f-4d93-aac3-c162fc304ef2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:12.239912 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1e1addac-e18f-4d93-aac3-c162fc304ef2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:12.257324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1e1addac-e18f-4d93-aac3-c162fc304ef2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1238 microversion: 2.1 time: 0.306498 Aug 04 13:57:12.258424 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 25/51] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:11 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1238 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:12.282833 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e4af6635-45e2-41bc-a87b-ca25c3c5389d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:12.283795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e4af6635-45e2-41bc-a87b-ca25c3c5389d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:12.305816 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e4af6635-45e2-41bc-a87b-ca25c3c5389d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:12.306382 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e4af6635-45e2-41bc-a87b-ca25c3c5389d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:12.307479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e4af6635-45e2-41bc-a87b-ca25c3c5389d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:12.308071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e4af6635-45e2-41bc-a87b-ca25c3c5389d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:12.627355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4716ec44-06c6-4dbe-b9ed-5daff9594259 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:12.635871 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4716ec44-06c6-4dbe-b9ed-5daff9594259 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.872364 Aug 04 13:57:12.641536 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 27/52] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:11 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:12.673351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-78f74ded-64bc-49d9-9ede-14c01fdd8b48 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:12.674592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-78f74ded-64bc-49d9-9ede-14c01fdd8b48 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:12.686988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78f74ded-64bc-49d9-9ede-14c01fdd8b48 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:12.687706 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78f74ded-64bc-49d9-9ede-14c01fdd8b48 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:12.689926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78f74ded-64bc-49d9-9ede-14c01fdd8b48 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:12.690835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78f74ded-64bc-49d9-9ede-14c01fdd8b48 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:12.809519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-78f74ded-64bc-49d9-9ede-14c01fdd8b48 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:12.824770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-78f74ded-64bc-49d9-9ede-14c01fdd8b48 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1282 microversion: 2.1 time: 0.180921 Aug 04 13:57:12.825386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 28/53] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:12 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:12.833609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e4af6635-45e2-41bc-a87b-ca25c3c5389d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:12.864414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e4af6635-45e2-41bc-a87b-ca25c3c5389d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.603684 Aug 04 13:57:12.864906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 26/54] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:12 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:12.961367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:12.966761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:12.977411 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:12.980402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:12.981438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:12.986599 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:13.164166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:13.176565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:13.178300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:13.192718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-08db5265-379b-4745-a3f2-1442edf61ded tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1333 microversion: 2.20 time: 0.222062 Aug 04 13:57:13.192718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 29/55] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:12 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1333 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:57:13.287703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-03aa7d0f-5ff3-42ba-adf9-ec31afabc537 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:13.289107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-03aa7d0f-5ff3-42ba-adf9-ec31afabc537 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:13.295333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03aa7d0f-5ff3-42ba-adf9-ec31afabc537 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:13.298147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03aa7d0f-5ff3-42ba-adf9-ec31afabc537 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:13.300695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03aa7d0f-5ff3-42ba-adf9-ec31afabc537 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:13.302303 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03aa7d0f-5ff3-42ba-adf9-ec31afabc537 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:13.436331 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-03aa7d0f-5ff3-42ba-adf9-ec31afabc537 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:13.464918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-03aa7d0f-5ff3-42ba-adf9-ec31afabc537 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1234 microversion: 2.1 time: 0.180479 Aug 04 13:57:13.466446 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 27/56] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:13 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1234 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:13.658800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8730ee6c-a526-484d-b398-471839852216 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:13.660162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8730ee6c-a526-484d-b398-471839852216 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:13.671317 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8730ee6c-a526-484d-b398-471839852216 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:13.672071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8730ee6c-a526-484d-b398-471839852216 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:13.678140 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8730ee6c-a526-484d-b398-471839852216 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:13.678860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8730ee6c-a526-484d-b398-471839852216 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:13.852604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ff829e61-f434-4717-bd5e-1a5eae305d36 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:13.853461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ff829e61-f434-4717-bd5e-1a5eae305d36 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:13.861396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff829e61-f434-4717-bd5e-1a5eae305d36 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:13.862020 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff829e61-f434-4717-bd5e-1a5eae305d36 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:13.862839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff829e61-f434-4717-bd5e-1a5eae305d36 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:13.863283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff829e61-f434-4717-bd5e-1a5eae305d36 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:13.993146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8730ee6c-a526-484d-b398-471839852216 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.001062 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8730ee6c-a526-484d-b398-471839852216 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.346503 Aug 04 13:57:14.011021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 30/57] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:13 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:14.016898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1bec4e84-8dc4-4a15-8d8f-6187dba0d5b9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:14.017939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1bec4e84-8dc4-4a15-8d8f-6187dba0d5b9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:14.024462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1bec4e84-8dc4-4a15-8d8f-6187dba0d5b9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:14.025272 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1bec4e84-8dc4-4a15-8d8f-6187dba0d5b9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:14.026355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1bec4e84-8dc4-4a15-8d8f-6187dba0d5b9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:14.026793 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1bec4e84-8dc4-4a15-8d8f-6187dba0d5b9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:14.079907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ff829e61-f434-4717-bd5e-1a5eae305d36 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.095995 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ff829e61-f434-4717-bd5e-1a5eae305d36 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1280 microversion: 2.1 time: 0.245693 Aug 04 13:57:14.097060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 28/58] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:13 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:14.203344 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:14.204444 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:14.225557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:14.228339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:14.229215 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:14.234418 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:14.278737 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1bec4e84-8dc4-4a15-8d8f-6187dba0d5b9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.292920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1bec4e84-8dc4-4a15-8d8f-6187dba0d5b9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.280097 Aug 04 13:57:14.294829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 31/59] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:14 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:14.491289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c89b2a35-bdf3-4ca2-ab70-41d0f54566d9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:14.496747 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c89b2a35-bdf3-4ca2-ab70-41d0f54566d9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:14.522690 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c89b2a35-bdf3-4ca2-ab70-41d0f54566d9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:14.523628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c89b2a35-bdf3-4ca2-ab70-41d0f54566d9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:14.531007 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.545298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c89b2a35-bdf3-4ca2-ab70-41d0f54566d9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:14.546203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c89b2a35-bdf3-4ca2-ab70-41d0f54566d9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:14.551924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.582660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.590615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3b8e1428-0065-4dc8-a452-479c909115ef tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1339 microversion: 2.20 time: 0.391415 Aug 04 13:57:14.591218 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 29/60] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:14 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1339 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:57:14.791942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c89b2a35-bdf3-4ca2-ab70-41d0f54566d9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.822243 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c89b2a35-bdf3-4ca2-ab70-41d0f54566d9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1308 microversion: 2.1 time: 0.339747 Aug 04 13:57:14.826704 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 32/61] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:14 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:15.036245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c66bea36-8ae4-437d-aba2-24c89129fe7b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.037080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c66bea36-8ae4-437d-aba2-24c89129fe7b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:15.068065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c66bea36-8ae4-437d-aba2-24c89129fe7b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.068550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c66bea36-8ae4-437d-aba2-24c89129fe7b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.069365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c66bea36-8ae4-437d-aba2-24c89129fe7b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.069812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c66bea36-8ae4-437d-aba2-24c89129fe7b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.117011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9d73ab55-cdfd-4c2b-a15c-1ed95e7bd0d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.118492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9d73ab55-cdfd-4c2b-a15c-1ed95e7bd0d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:15.141626 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d73ab55-cdfd-4c2b-a15c-1ed95e7bd0d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.142368 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d73ab55-cdfd-4c2b-a15c-1ed95e7bd0d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.144550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d73ab55-cdfd-4c2b-a15c-1ed95e7bd0d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.146549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d73ab55-cdfd-4c2b-a15c-1ed95e7bd0d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.593780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c66bea36-8ae4-437d-aba2-24c89129fe7b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:15.603684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9d73ab55-cdfd-4c2b-a15c-1ed95e7bd0d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:15.606550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c66bea36-8ae4-437d-aba2-24c89129fe7b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.584035 Aug 04 13:57:15.610724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 30/62] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:15 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:15.633073 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b6e365c1-d46a-486f-94a5-3e1511f41230 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.633301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9d73ab55-cdfd-4c2b-a15c-1ed95e7bd0d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.522001 Aug 04 13:57:15.634464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 33/63] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:15 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:15.636767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b6e365c1-d46a-486f-94a5-3e1511f41230 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:15.650679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b6e365c1-d46a-486f-94a5-3e1511f41230 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.652189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.653546 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b6e365c1-d46a-486f-94a5-3e1511f41230 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.657051 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b6e365c1-d46a-486f-94a5-3e1511f41230 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.657740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b6e365c1-d46a-486f-94a5-3e1511f41230 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.660291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:15.671727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.673033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.684671 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.685593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.863228 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:15.875421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:15.883876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:15.885357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ee2ef3ba-3aa7-440f-bf1d-7cac7b273618 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1339 microversion: 2.20 time: 0.246905 Aug 04 13:57:15.886227 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 34/64] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:15 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1339 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:15.896312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e15aee71-2205-4157-b2db-0ac9714e8926 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.901754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e15aee71-2205-4157-b2db-0ac9714e8926 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:15.917164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e15aee71-2205-4157-b2db-0ac9714e8926 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.917924 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e15aee71-2205-4157-b2db-0ac9714e8926 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:15.918749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e15aee71-2205-4157-b2db-0ac9714e8926 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:15.919193 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e15aee71-2205-4157-b2db-0ac9714e8926 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:16.063234 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e15aee71-2205-4157-b2db-0ac9714e8926 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:16.082741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e15aee71-2205-4157-b2db-0ac9714e8926 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1296 microversion: 2.1 time: 0.195208 Aug 04 13:57:16.085146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 35/65] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:15 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1296 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:16.393552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b6e365c1-d46a-486f-94a5-3e1511f41230 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:16.404283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b6e365c1-d46a-486f-94a5-3e1511f41230 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.789001 Aug 04 13:57:16.413367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 31/66] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:15 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:16.632199 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1726ebd4-2f31-4981-974a-b7a9882691d9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:16.632898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1726ebd4-2f31-4981-974a-b7a9882691d9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:16.650943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-864090e3-cf39-4ec8-b6aa-dba7affdcd7e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:16.653356 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-864090e3-cf39-4ec8-b6aa-dba7affdcd7e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:16.670281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1726ebd4-2f31-4981-974a-b7a9882691d9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:16.673324 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1726ebd4-2f31-4981-974a-b7a9882691d9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:16.674081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-864090e3-cf39-4ec8-b6aa-dba7affdcd7e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:16.675317 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-864090e3-cf39-4ec8-b6aa-dba7affdcd7e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:16.676756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-864090e3-cf39-4ec8-b6aa-dba7affdcd7e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:16.678473 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1726ebd4-2f31-4981-974a-b7a9882691d9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:16.678927 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1726ebd4-2f31-4981-974a-b7a9882691d9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:16.679126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-864090e3-cf39-4ec8-b6aa-dba7affdcd7e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.246053 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1726ebd4-2f31-4981-974a-b7a9882691d9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:17.254493 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1726ebd4-2f31-4981-974a-b7a9882691d9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.627529 Aug 04 13:57:17.258935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 36/67] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:16 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:17.267824 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:17.268728 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:17.305715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.306702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.313239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.321399 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.367238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-864090e3-cf39-4ec8-b6aa-dba7affdcd7e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:17.380790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-864090e3-cf39-4ec8-b6aa-dba7affdcd7e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.733826 Aug 04 13:57:17.385384 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 32/68] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:16 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:17.390747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a0f8866b-9f3d-4592-871d-fd193f69a99e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:17.397517 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a0f8866b-9f3d-4592-871d-fd193f69a99e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:17.416492 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0f8866b-9f3d-4592-871d-fd193f69a99e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.417437 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0f8866b-9f3d-4592-871d-fd193f69a99e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.419180 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0f8866b-9f3d-4592-871d-fd193f69a99e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.421094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0f8866b-9f3d-4592-871d-fd193f69a99e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.796881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:17.811037 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:17.813190 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:17.824901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-89b84bef-28d1-4ec1-af8d-6de657d523a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.557984 Aug 04 13:57:17.826089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 37/69] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:17 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:17.838545 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a0f8866b-9f3d-4592-871d-fd193f69a99e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:17.851762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a0f8866b-9f3d-4592-871d-fd193f69a99e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.463414 Aug 04 13:57:17.856520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 33/70] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:17 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:17.870691 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-2b0f141c-b664-4621-82cd-c5a02fc1cafe req-92d910cd-0aa9-4038-8c62-75fed636f4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1daa517-619e-4605-8c20-906b075afd41", "tag": "0e6069d0-3962-435f-bbec-6c8cd1f4930d"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:17.875002 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7c2b8334-e740-4836-bcd1-260d411448c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:17.877079 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:17.877079 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:57:17.877965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7c2b8334-e740-4836-bcd1-260d411448c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:17.889495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7c2b8334-e740-4836-bcd1-260d411448c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.891176 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7c2b8334-e740-4836-bcd1-260d411448c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.893241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7c2b8334-e740-4836-bcd1-260d411448c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.894630 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7c2b8334-e740-4836-bcd1-260d411448c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.907277 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-2b0f141c-b664-4621-82cd-c5a02fc1cafe req-92d910cd-0aa9-4038-8c62-75fed636f4ff service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.908091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-2b0f141c-b664-4621-82cd-c5a02fc1cafe req-92d910cd-0aa9-4038-8c62-75fed636f4ff service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.961198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-2b0f141c-b664-4621-82cd-c5a02fc1cafe req-92d910cd-0aa9-4038-8c62-75fed636f4ff service nova] Creating event network-changed:0e6069d0-3962-435f-bbec-6c8cd1f4930d for instance d1daa517-619e-4605-8c20-906b075afd41 on hv-cinder-79264 Aug 04 13:57:17.965076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-2b0f141c-b664-4621-82cd-c5a02fc1cafe req-92d910cd-0aa9-4038-8c62-75fed636f4ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=107822) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 04 13:57:17.971483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b4b9cc9-da81-4b8e-924b-b6995ebae23d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.972323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b4b9cc9-da81-4b8e-924b-b6995ebae23d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.973411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b4b9cc9-da81-4b8e-924b-b6995ebae23d None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:17.975463 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b4b9cc9-da81-4b8e-924b-b6995ebae23d None None] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:17.992911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.compute.rpcapi [None req-7b4b9cc9-da81-4b8e-924b-b6995ebae23d None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 04 13:57:18.011915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b4b9cc9-da81-4b8e-924b-b6995ebae23d None None] Releasing lock "compute-rpcapi-router" {{(pid=107822) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 04 13:57:18.069227 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7b4b9cc9-da81-4b8e-924b-b6995ebae23d None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209217 Aug 04 13:57:18.069883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 34/71] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:18.209884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-ec71e3f8-0d56-42e1-8ab6-b6cb079433f6 req-8c6cd730-b1ad-4062-ab1a-088885ee33ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1349a3-e392-480b-84ed-d851137f5a0c", "tag": "c35367a7-2079-4165-ae77-a51b6092b849"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:18.213099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:18.213099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:57:18.256479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-ec71e3f8-0d56-42e1-8ab6-b6cb079433f6 req-8c6cd730-b1ad-4062-ab1a-088885ee33ef service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:18.257400 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-ec71e3f8-0d56-42e1-8ab6-b6cb079433f6 req-8c6cd730-b1ad-4062-ab1a-088885ee33ef service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:18.282509 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-ec71e3f8-0d56-42e1-8ab6-b6cb079433f6 req-8c6cd730-b1ad-4062-ab1a-088885ee33ef service nova] Creating event network-changed:c35367a7-2079-4165-ae77-a51b6092b849 for instance 2c1349a3-e392-480b-84ed-d851137f5a0c on hv-cinder-79264 Aug 04 13:57:18.290437 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-ec71e3f8-0d56-42e1-8ab6-b6cb079433f6 req-8c6cd730-b1ad-4062-ab1a-088885ee33ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088144 Aug 04 13:57:18.291802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 35/72] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:57:18.299111 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c4b7047c-23ac-4d3e-916a-7a21f4664da1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:18.300286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c4b7047c-23ac-4d3e-916a-7a21f4664da1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:18.311648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4b7047c-23ac-4d3e-916a-7a21f4664da1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:18.312246 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4b7047c-23ac-4d3e-916a-7a21f4664da1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:18.314350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4b7047c-23ac-4d3e-916a-7a21f4664da1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:18.315068 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4b7047c-23ac-4d3e-916a-7a21f4664da1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:18.774895 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7c2b8334-e740-4836-bcd1-260d411448c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:18.803138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7c2b8334-e740-4836-bcd1-260d411448c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.975189 Aug 04 13:57:18.803746 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 38/73] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:17 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:18.821306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-581f77e9-c99f-4433-8500-253e1d1d5224 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:18.821306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-581f77e9-c99f-4433-8500-253e1d1d5224 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:18.827689 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-581f77e9-c99f-4433-8500-253e1d1d5224 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:18.828197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-581f77e9-c99f-4433-8500-253e1d1d5224 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:18.829646 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-581f77e9-c99f-4433-8500-253e1d1d5224 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:18.830068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-581f77e9-c99f-4433-8500-253e1d1d5224 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:19.170927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c4b7047c-23ac-4d3e-916a-7a21f4664da1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:19.184254 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c4b7047c-23ac-4d3e-916a-7a21f4664da1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.890421 Aug 04 13:57:19.186570 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 36/74] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:18 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:19.198636 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:19.199641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:19.217369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:19.220890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:19.221877 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:19.222664 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:19.371319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-581f77e9-c99f-4433-8500-253e1d1d5224 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:19.401120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-581f77e9-c99f-4433-8500-253e1d1d5224 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.595938 Aug 04 13:57:19.411925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 39/75] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:18 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:19.425818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f395d0e8-fda6-4e13-af6f-d4a07790100a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:19.426725 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f395d0e8-fda6-4e13-af6f-d4a07790100a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:19.436504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f395d0e8-fda6-4e13-af6f-d4a07790100a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:19.437245 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f395d0e8-fda6-4e13-af6f-d4a07790100a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:19.441720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f395d0e8-fda6-4e13-af6f-d4a07790100a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:19.442565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f395d0e8-fda6-4e13-af6f-d4a07790100a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:19.644549 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:19.658395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:19.661275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:19.663226 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c2005630-348c-41eb-b20c-56b4b980573b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.471990 Aug 04 13:57:19.664085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 37/76] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:19 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:19.749356 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f395d0e8-fda6-4e13-af6f-d4a07790100a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:19.768132 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f395d0e8-fda6-4e13-af6f-d4a07790100a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.354600 Aug 04 13:57:19.772914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 40/77] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:19 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:19.831197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c83a3b85-496d-4965-9fc5-dd87211a3a1a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:19.832193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c83a3b85-496d-4965-9fc5-dd87211a3a1a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:19.840934 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c83a3b85-496d-4965-9fc5-dd87211a3a1a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:19.841824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c83a3b85-496d-4965-9fc5-dd87211a3a1a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:19.842987 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c83a3b85-496d-4965-9fc5-dd87211a3a1a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:19.843920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c83a3b85-496d-4965-9fc5-dd87211a3a1a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.207687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a477457a-827c-46ec-9d6e-72d58e9cfbab tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:20.209278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a477457a-827c-46ec-9d6e-72d58e9cfbab tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:20.221351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a477457a-827c-46ec-9d6e-72d58e9cfbab tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.222056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a477457a-827c-46ec-9d6e-72d58e9cfbab tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.223061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a477457a-827c-46ec-9d6e-72d58e9cfbab tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.223661 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a477457a-827c-46ec-9d6e-72d58e9cfbab tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.423646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c83a3b85-496d-4965-9fc5-dd87211a3a1a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.434992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c83a3b85-496d-4965-9fc5-dd87211a3a1a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.607684 Aug 04 13:57:20.436037 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 38/78] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:19 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:20.442924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-63a5b675-0a4b-4238-882d-0d689b902be0 req-a266361f-24c3-494f-ac69-c3e4fb4e5b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a6e241-9234-4ca1-b4ca-7b90733ab705", "tag": "828cc1c2-4556-4cd2-a0e7-2ed9383548e4"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:20.450039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:20.450039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:57:20.458700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-63a5b675-0a4b-4238-882d-0d689b902be0 req-a266361f-24c3-494f-ac69-c3e4fb4e5b07 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.459130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-63a5b675-0a4b-4238-882d-0d689b902be0 req-a266361f-24c3-494f-ac69-c3e4fb4e5b07 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.472294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-63a5b675-0a4b-4238-882d-0d689b902be0 req-a266361f-24c3-494f-ac69-c3e4fb4e5b07 service nova] Creating event network-changed:828cc1c2-4556-4cd2-a0e7-2ed9383548e4 for instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 on hv-cinder-79264 Aug 04 13:57:20.478367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-63a5b675-0a4b-4238-882d-0d689b902be0 req-a266361f-24c3-494f-ac69-c3e4fb4e5b07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040591 Aug 04 13:57:20.479815 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 39/79] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:20.487054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0164b06e-4b4d-42fb-9261-f660cde2d153 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:20.488325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0164b06e-4b4d-42fb-9261-f660cde2d153 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:20.499482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0164b06e-4b4d-42fb-9261-f660cde2d153 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.501214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0164b06e-4b4d-42fb-9261-f660cde2d153 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.502417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0164b06e-4b4d-42fb-9261-f660cde2d153 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.502954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0164b06e-4b4d-42fb-9261-f660cde2d153 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.639489 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a477457a-827c-46ec-9d6e-72d58e9cfbab tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.648812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a477457a-827c-46ec-9d6e-72d58e9cfbab tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.448501 Aug 04 13:57:20.659261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 41/80] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:20 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:20.702549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:20.703166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:20.710777 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.711437 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.712475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.713114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.713811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0164b06e-4b4d-42fb-9261-f660cde2d153 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.725267 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0164b06e-4b4d-42fb-9261-f660cde2d153 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.243583 Aug 04 13:57:20.725929 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 40/81] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:20 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:20.799779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e11bd462-8fe8-4326-9988-459236659804 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:20.800812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e11bd462-8fe8-4326-9988-459236659804 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:20.808699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e11bd462-8fe8-4326-9988-459236659804 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.809496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e11bd462-8fe8-4326-9988-459236659804 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.810956 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e11bd462-8fe8-4326-9988-459236659804 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:20.812045 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e11bd462-8fe8-4326-9988-459236659804 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:20.870217 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.879096 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.880717 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.881861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0eefb371-794f-4841-a1dc-25c20cf2e8b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.183147 Aug 04 13:57:20.882497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 42/82] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:20 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:21.022520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e11bd462-8fe8-4326-9988-459236659804 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:21.036454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e11bd462-8fe8-4326-9988-459236659804 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.240894 Aug 04 13:57:21.037542 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 41/83] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:20 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:21.454333 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e9ec9180-a239-4abe-9cf7-3c5324e09f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:21.455653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e9ec9180-a239-4abe-9cf7-3c5324e09f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:21.462599 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9ec9180-a239-4abe-9cf7-3c5324e09f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:21.463051 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9ec9180-a239-4abe-9cf7-3c5324e09f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:21.463904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9ec9180-a239-4abe-9cf7-3c5324e09f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:21.464401 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9ec9180-a239-4abe-9cf7-3c5324e09f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:21.660867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e9ec9180-a239-4abe-9cf7-3c5324e09f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:21.666318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cd367870-47e3-47a2-be94-64178fbc673c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:21.667120 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cd367870-47e3-47a2-be94-64178fbc673c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:21.674411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd367870-47e3-47a2-be94-64178fbc673c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:21.674860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd367870-47e3-47a2-be94-64178fbc673c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:21.675793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd367870-47e3-47a2-be94-64178fbc673c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:21.676253 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd367870-47e3-47a2-be94-64178fbc673c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:21.680269 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e9ec9180-a239-4abe-9cf7-3c5324e09f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.230168 Aug 04 13:57:21.682087 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 43/84] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:21 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:21.747515 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fbbb98b2-f71b-4584-a4fb-1922c7cee669 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:21.748944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fbbb98b2-f71b-4584-a4fb-1922c7cee669 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:21.763756 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbbb98b2-f71b-4584-a4fb-1922c7cee669 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:21.765467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbbb98b2-f71b-4584-a4fb-1922c7cee669 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:21.768439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbbb98b2-f71b-4584-a4fb-1922c7cee669 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:21.769900 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbbb98b2-f71b-4584-a4fb-1922c7cee669 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:21.852973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd367870-47e3-47a2-be94-64178fbc673c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:21.862943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cd367870-47e3-47a2-be94-64178fbc673c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.200489 Aug 04 13:57:21.863747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 42/85] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:21 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:21.903172 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:21.904243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:21.911816 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:21.912445 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:21.913534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:21.914073 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:21.974583 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fbbb98b2-f71b-4584-a4fb-1922c7cee669 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:21.982968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fbbb98b2-f71b-4584-a4fb-1922c7cee669 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.243172 Aug 04 13:57:21.983755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 44/86] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:21 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:22.059433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-dba1a8d7-e2d4-491a-b287-a2b528a1cfcc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:22.060352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-dba1a8d7-e2d4-491a-b287-a2b528a1cfcc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:22.067074 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dba1a8d7-e2d4-491a-b287-a2b528a1cfcc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:22.067654 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dba1a8d7-e2d4-491a-b287-a2b528a1cfcc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:22.068496 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dba1a8d7-e2d4-491a-b287-a2b528a1cfcc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:22.068906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:22.069058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dba1a8d7-e2d4-491a-b287-a2b528a1cfcc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:22.079911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:22.081657 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:22.082821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8bcf9396-d5dc-4456-bc81-092a86197282 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.183377 Aug 04 13:57:22.083377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 43/87] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:21 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:22.216027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-dba1a8d7-e2d4-491a-b287-a2b528a1cfcc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:22.230892 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-dba1a8d7-e2d4-491a-b287-a2b528a1cfcc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.177870 Aug 04 13:57:22.231937 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 45/88] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:22 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:22.701601 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ed304977-e4ec-49a5-950a-2470cd69bafe tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:22.702220 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ed304977-e4ec-49a5-950a-2470cd69bafe tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:22.709551 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ed304977-e4ec-49a5-950a-2470cd69bafe tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:22.710037 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ed304977-e4ec-49a5-950a-2470cd69bafe tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:22.711047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ed304977-e4ec-49a5-950a-2470cd69bafe tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:22.711484 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ed304977-e4ec-49a5-950a-2470cd69bafe tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:22.889348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d524c2d9-262b-445e-8c26-ad4be19e5c00 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:22.890173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d524c2d9-262b-445e-8c26-ad4be19e5c00 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:22.896863 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d524c2d9-262b-445e-8c26-ad4be19e5c00 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:22.897561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d524c2d9-262b-445e-8c26-ad4be19e5c00 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:22.898350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d524c2d9-262b-445e-8c26-ad4be19e5c00 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:22.898777 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d524c2d9-262b-445e-8c26-ad4be19e5c00 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:22.914115 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ed304977-e4ec-49a5-950a-2470cd69bafe tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:22.938470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ed304977-e4ec-49a5-950a-2470cd69bafe tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.240616 Aug 04 13:57:22.939340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 44/89] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:22 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:23.007494 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a3e84dc5-68a7-4752-9115-1d5ee4fe8cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:23.008832 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a3e84dc5-68a7-4752-9115-1d5ee4fe8cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:23.022826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a3e84dc5-68a7-4752-9115-1d5ee4fe8cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:23.023776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a3e84dc5-68a7-4752-9115-1d5ee4fe8cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:23.025654 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a3e84dc5-68a7-4752-9115-1d5ee4fe8cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:23.026269 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a3e84dc5-68a7-4752-9115-1d5ee4fe8cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:23.116138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d524c2d9-262b-445e-8c26-ad4be19e5c00 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.132500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d524c2d9-262b-445e-8c26-ad4be19e5c00 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.246615 Aug 04 13:57:23.134283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 46/90] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:22 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:23.144723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:23.145877 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:23.159205 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:23.160087 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:23.161568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:23.162357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:23.176183 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a3e84dc5-68a7-4752-9115-1d5ee4fe8cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.184060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a3e84dc5-68a7-4752-9115-1d5ee4fe8cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.186238 Aug 04 13:57:23.184704 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 45/91] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:22 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:23.249719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b47d5b7-7e3c-436f-b389-3a2ea3ff9c15 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:23.250333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b47d5b7-7e3c-436f-b389-3a2ea3ff9c15 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:23.260301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b47d5b7-7e3c-436f-b389-3a2ea3ff9c15 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:23.263785 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b47d5b7-7e3c-436f-b389-3a2ea3ff9c15 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:23.265375 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b47d5b7-7e3c-436f-b389-3a2ea3ff9c15 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:23.271102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b47d5b7-7e3c-436f-b389-3a2ea3ff9c15 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:23.324663 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.334105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.337701 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.338846 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d5b94942-73cc-410f-937f-1ec08d4789fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.203058 Aug 04 13:57:23.339423 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 47/92] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:23 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:23.482154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1b47d5b7-7e3c-436f-b389-3a2ea3ff9c15 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.493867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b47d5b7-7e3c-436f-b389-3a2ea3ff9c15 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.248467 Aug 04 13:57:23.494565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 46/93] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:23 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:23.957885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-17dcfe50-0de6-4ae3-b827-2cc4cfec3b0d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:23.958496 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-17dcfe50-0de6-4ae3-b827-2cc4cfec3b0d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:23.965970 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17dcfe50-0de6-4ae3-b827-2cc4cfec3b0d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:23.966493 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17dcfe50-0de6-4ae3-b827-2cc4cfec3b0d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:23.967722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17dcfe50-0de6-4ae3-b827-2cc4cfec3b0d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:23.968295 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17dcfe50-0de6-4ae3-b827-2cc4cfec3b0d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.131813 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-17dcfe50-0de6-4ae3-b827-2cc4cfec3b0d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.146285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-17dcfe50-0de6-4ae3-b827-2cc4cfec3b0d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.192282 Aug 04 13:57:24.157147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 48/94] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:23 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:24.162056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-95d7e5e6-3279-4bac-9457-620965a58a0b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:24.162860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-95d7e5e6-3279-4bac-9457-620965a58a0b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:24.173260 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95d7e5e6-3279-4bac-9457-620965a58a0b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:24.174066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95d7e5e6-3279-4bac-9457-620965a58a0b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.175635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95d7e5e6-3279-4bac-9457-620965a58a0b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:24.176451 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95d7e5e6-3279-4bac-9457-620965a58a0b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.207444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4c87bf40-8e1a-4897-a527-cd30fbc29937 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:24.208737 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4c87bf40-8e1a-4897-a527-cd30fbc29937 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:24.223137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c87bf40-8e1a-4897-a527-cd30fbc29937 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:24.229585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c87bf40-8e1a-4897-a527-cd30fbc29937 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.231576 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c87bf40-8e1a-4897-a527-cd30fbc29937 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:24.232401 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c87bf40-8e1a-4897-a527-cd30fbc29937 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.421530 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4c87bf40-8e1a-4897-a527-cd30fbc29937 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.433543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4c87bf40-8e1a-4897-a527-cd30fbc29937 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.234242 Aug 04 13:57:24.435546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 49/95] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:24 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:24.460401 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:24.471881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:24.505224 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:24.506301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.507485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:24.508048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.542931 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-95d7e5e6-3279-4bac-9457-620965a58a0b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.557932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-95d7e5e6-3279-4bac-9457-620965a58a0b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.410154 Aug 04 13:57:24.558957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 47/96] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:24 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:24.567702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c7a006c8-666d-4d35-b672-3baef67b8933 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:24.569088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c7a006c8-666d-4d35-b672-3baef67b8933 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:24.580352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7a006c8-666d-4d35-b672-3baef67b8933 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:24.581160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7a006c8-666d-4d35-b672-3baef67b8933 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.583120 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7a006c8-666d-4d35-b672-3baef67b8933 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:24.584637 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7a006c8-666d-4d35-b672-3baef67b8933 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:24.793613 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c7a006c8-666d-4d35-b672-3baef67b8933 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.802445 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.802797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c7a006c8-666d-4d35-b672-3baef67b8933 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.241876 Aug 04 13:57:24.803615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 48/97] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:24 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:24.822908 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.826728 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.832535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2a504bac-8321-4a78-b67e-8ad91b5a4299 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.391354 Aug 04 13:57:24.833694 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 50/98] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:24 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:25.167022 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a579de23-f726-4858-834f-c5a736ebcd3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.168171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a579de23-f726-4858-834f-c5a736ebcd3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:25.177464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a579de23-f726-4858-834f-c5a736ebcd3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.178081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a579de23-f726-4858-834f-c5a736ebcd3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.179500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a579de23-f726-4858-834f-c5a736ebcd3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.180133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a579de23-f726-4858-834f-c5a736ebcd3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.358150 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a579de23-f726-4858-834f-c5a736ebcd3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:25.369646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a579de23-f726-4858-834f-c5a736ebcd3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.206832 Aug 04 13:57:25.371704 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 49/99] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:25 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:25.461875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-70f8585c-efb8-4525-8c7a-c62a6a01a213 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.463253 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-70f8585c-efb8-4525-8c7a-c62a6a01a213 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:25.469919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70f8585c-efb8-4525-8c7a-c62a6a01a213 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.470678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70f8585c-efb8-4525-8c7a-c62a6a01a213 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.471497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70f8585c-efb8-4525-8c7a-c62a6a01a213 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.472103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70f8585c-efb8-4525-8c7a-c62a6a01a213 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.577969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a69f891e-4508-4b08-bc30-653c5af8b4e3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.579455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a69f891e-4508-4b08-bc30-653c5af8b4e3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:25.594764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a69f891e-4508-4b08-bc30-653c5af8b4e3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.596668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a69f891e-4508-4b08-bc30-653c5af8b4e3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.598137 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a69f891e-4508-4b08-bc30-653c5af8b4e3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.598947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a69f891e-4508-4b08-bc30-653c5af8b4e3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.758731 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-70f8585c-efb8-4525-8c7a-c62a6a01a213 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:25.771620 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-70f8585c-efb8-4525-8c7a-c62a6a01a213 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.314674 Aug 04 13:57:25.772298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 51/100] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:25 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:25.821524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-540e8216-0dd7-48da-8987-700bc4c9b35c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.822590 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-540e8216-0dd7-48da-8987-700bc4c9b35c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:25.833617 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-540e8216-0dd7-48da-8987-700bc4c9b35c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.835020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-540e8216-0dd7-48da-8987-700bc4c9b35c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.836642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-540e8216-0dd7-48da-8987-700bc4c9b35c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.837806 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-540e8216-0dd7-48da-8987-700bc4c9b35c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.867815 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a69f891e-4508-4b08-bc30-653c5af8b4e3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:25.889408 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a69f891e-4508-4b08-bc30-653c5af8b4e3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.316601 Aug 04 13:57:25.890547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 50/101] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:25 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:25.895932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.899725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:25.908676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.909582 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:25.910645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:25.911328 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:26.062077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.072687 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.074329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.076049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4265fe68-e137-4918-a93c-37b4937592b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.183597 Aug 04 13:57:26.077182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 51/102] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:25 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:26.198508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-540e8216-0dd7-48da-8987-700bc4c9b35c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.207408 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-540e8216-0dd7-48da-8987-700bc4c9b35c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.390926 Aug 04 13:57:26.208265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 52/103] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:25 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:26.403103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-293ab798-68a4-4e41-a2b9-5f2a637ef0d3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.405190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-293ab798-68a4-4e41-a2b9-5f2a637ef0d3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:26.418779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-293ab798-68a4-4e41-a2b9-5f2a637ef0d3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:26.418779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-293ab798-68a4-4e41-a2b9-5f2a637ef0d3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:26.419552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-293ab798-68a4-4e41-a2b9-5f2a637ef0d3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:26.420056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-293ab798-68a4-4e41-a2b9-5f2a637ef0d3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:26.596749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-293ab798-68a4-4e41-a2b9-5f2a637ef0d3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.613942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-293ab798-68a4-4e41-a2b9-5f2a637ef0d3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.217588 Aug 04 13:57:26.615447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 52/104] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:26 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:26.811433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-02c84362-026d-41c5-95e1-76f09d1a58de tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.814035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-02c84362-026d-41c5-95e1-76f09d1a58de tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:26.825655 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-02c84362-026d-41c5-95e1-76f09d1a58de tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:26.826800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-02c84362-026d-41c5-95e1-76f09d1a58de tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:26.828942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-02c84362-026d-41c5-95e1-76f09d1a58de tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:26.829976 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-02c84362-026d-41c5-95e1-76f09d1a58de tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:26.922452 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9a4561d4-299b-4ca0-9b53-885eca095967 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.923701 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9a4561d4-299b-4ca0-9b53-885eca095967 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:26.938556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a4561d4-299b-4ca0-9b53-885eca095967 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:26.938556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a4561d4-299b-4ca0-9b53-885eca095967 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:26.938556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a4561d4-299b-4ca0-9b53-885eca095967 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:26.938556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a4561d4-299b-4ca0-9b53-885eca095967 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:27.154243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9a4561d4-299b-4ca0-9b53-885eca095967 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.164467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9a4561d4-299b-4ca0-9b53-885eca095967 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.247967 Aug 04 13:57:27.168400 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 53/105] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:26 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:27.172964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.174042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:27.181224 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:27.181909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:27.182872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:27.183308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:27.315346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-02c84362-026d-41c5-95e1-76f09d1a58de tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.342179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-02c84362-026d-41c5-95e1-76f09d1a58de tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.552901 Aug 04 13:57:27.345318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 53/106] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:26 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:27.355723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ef825b31-c49a-41b3-84ac-77c8ed884125 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.358224 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ef825b31-c49a-41b3-84ac-77c8ed884125 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:27.379425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef825b31-c49a-41b3-84ac-77c8ed884125 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:27.379878 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef825b31-c49a-41b3-84ac-77c8ed884125 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:27.380731 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef825b31-c49a-41b3-84ac-77c8ed884125 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:27.381167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef825b31-c49a-41b3-84ac-77c8ed884125 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:27.416057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.429624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.431474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.432366 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-17f606b5-f786-4b1d-a326-2832b3aaaf84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.265643 Aug 04 13:57:27.433365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 54/107] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:27 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:27.620431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ef825b31-c49a-41b3-84ac-77c8ed884125 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.632171 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ef825b31-c49a-41b3-84ac-77c8ed884125 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.285347 Aug 04 13:57:27.635273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 54/108] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:27 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:27.647641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a56f0254-79ab-4063-ae6c-456a2897b250 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.649281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a56f0254-79ab-4063-ae6c-456a2897b250 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:27.668372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a56f0254-79ab-4063-ae6c-456a2897b250 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:27.669410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a56f0254-79ab-4063-ae6c-456a2897b250 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:27.671579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a56f0254-79ab-4063-ae6c-456a2897b250 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:27.673046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a56f0254-79ab-4063-ae6c-456a2897b250 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:28.056725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a56f0254-79ab-4063-ae6c-456a2897b250 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.067718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a56f0254-79ab-4063-ae6c-456a2897b250 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.439082 Aug 04 13:57:28.079144 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 55/109] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:27 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:28.196245 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-21011284-3bb9-4288-9d9f-c90f528f70bd tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:28.198582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-21011284-3bb9-4288-9d9f-c90f528f70bd tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:28.211526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21011284-3bb9-4288-9d9f-c90f528f70bd tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:28.212647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21011284-3bb9-4288-9d9f-c90f528f70bd tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:28.214426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21011284-3bb9-4288-9d9f-c90f528f70bd tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:28.215434 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21011284-3bb9-4288-9d9f-c90f528f70bd tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:28.380874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3c72e903-7b7b-4e6c-b86c-c3979c8be2bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:28.382378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3c72e903-7b7b-4e6c-b86c-c3979c8be2bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:28.404281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3c72e903-7b7b-4e6c-b86c-c3979c8be2bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:28.419863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3c72e903-7b7b-4e6c-b86c-c3979c8be2bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:28.421405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3c72e903-7b7b-4e6c-b86c-c3979c8be2bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:28.423627 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3c72e903-7b7b-4e6c-b86c-c3979c8be2bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:28.495319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-21011284-3bb9-4288-9d9f-c90f528f70bd tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.504274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-21011284-3bb9-4288-9d9f-c90f528f70bd tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.316640 Aug 04 13:57:28.504867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 55/110] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:28 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:28.510238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:28.511212 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:28.518954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:28.519687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:28.520695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:28.521288 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:28.697220 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3c72e903-7b7b-4e6c-b86c-c3979c8be2bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.706591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.719067 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3c72e903-7b7b-4e6c-b86c-c3979c8be2bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.353833 Aug 04 13:57:28.728448 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 56/111] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:28 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:28.728858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.732560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.734140 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2748f939-acc1-4a9e-ae18-edbcb2467d7a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.227780 Aug 04 13:57:28.735808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 56/112] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:28 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:28.737626 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d79edffc-44d6-4a00-ad6d-d7a930e244f3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:28.740042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d79edffc-44d6-4a00-ad6d-d7a930e244f3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:28.753270 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d79edffc-44d6-4a00-ad6d-d7a930e244f3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:28.754602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d79edffc-44d6-4a00-ad6d-d7a930e244f3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:28.756664 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d79edffc-44d6-4a00-ad6d-d7a930e244f3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:28.757944 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d79edffc-44d6-4a00-ad6d-d7a930e244f3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:29.034974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d79edffc-44d6-4a00-ad6d-d7a930e244f3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:29.046656 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d79edffc-44d6-4a00-ad6d-d7a930e244f3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.316809 Aug 04 13:57:29.047999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 57/113] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:28 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:29.089484 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-68296153-97f9-48b1-866c-ebf902c83d14 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.091010 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-68296153-97f9-48b1-866c-ebf902c83d14 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:29.102937 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68296153-97f9-48b1-866c-ebf902c83d14 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:29.103853 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68296153-97f9-48b1-866c-ebf902c83d14 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:29.105352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68296153-97f9-48b1-866c-ebf902c83d14 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:29.106148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68296153-97f9-48b1-866c-ebf902c83d14 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:29.376638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-68296153-97f9-48b1-866c-ebf902c83d14 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:29.395657 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-68296153-97f9-48b1-866c-ebf902c83d14 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.313023 Aug 04 13:57:29.405818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 57/114] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:29 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:29.524092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8bfa62f3-7c95-4c2b-9135-5e152e88f1a8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.525480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8bfa62f3-7c95-4c2b-9135-5e152e88f1a8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:29.532624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8bfa62f3-7c95-4c2b-9135-5e152e88f1a8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:29.533602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8bfa62f3-7c95-4c2b-9135-5e152e88f1a8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:29.534652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8bfa62f3-7c95-4c2b-9135-5e152e88f1a8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:29.535364 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8bfa62f3-7c95-4c2b-9135-5e152e88f1a8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:29.737238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-846d09c7-416b-49b5-b022-5d7dc78bd997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.738335 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-846d09c7-416b-49b5-b022-5d7dc78bd997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:29.749927 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-846d09c7-416b-49b5-b022-5d7dc78bd997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:29.750277 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-846d09c7-416b-49b5-b022-5d7dc78bd997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:29.751131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-846d09c7-416b-49b5-b022-5d7dc78bd997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:29.759166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-846d09c7-416b-49b5-b022-5d7dc78bd997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:29.808948 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8bfa62f3-7c95-4c2b-9135-5e152e88f1a8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:29.821914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8bfa62f3-7c95-4c2b-9135-5e152e88f1a8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.302861 Aug 04 13:57:29.822518 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 58/115] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:29 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:29.834525 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.835243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:29.851630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:29.852086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:29.861710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:29.862262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:30.007808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-846d09c7-416b-49b5-b022-5d7dc78bd997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:30.041265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-846d09c7-416b-49b5-b022-5d7dc78bd997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.308322 Aug 04 13:57:30.041880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 58/116] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:29 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:30.067329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-525aec7e-86f3-4969-a7fc-7411ef42d7a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:30.067956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-525aec7e-86f3-4969-a7fc-7411ef42d7a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:30.075991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-525aec7e-86f3-4969-a7fc-7411ef42d7a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:30.076471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-525aec7e-86f3-4969-a7fc-7411ef42d7a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:30.078294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-525aec7e-86f3-4969-a7fc-7411ef42d7a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:30.078902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-525aec7e-86f3-4969-a7fc-7411ef42d7a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:30.206192 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:30.223042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:30.226895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:30.230246 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-78832665-3455-416c-8547-049fa00e3de0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.406167 Aug 04 13:57:30.232509 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 59/117] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:29 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:30.276289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-525aec7e-86f3-4969-a7fc-7411ef42d7a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:30.285303 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-525aec7e-86f3-4969-a7fc-7411ef42d7a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.222658 Aug 04 13:57:30.288752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 59/118] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:30 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:30.414334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e7086c65-d621-441f-a1c9-1e97901e79d2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:30.414950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e7086c65-d621-441f-a1c9-1e97901e79d2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:30.421279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e7086c65-d621-441f-a1c9-1e97901e79d2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:30.422583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e7086c65-d621-441f-a1c9-1e97901e79d2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:30.423168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e7086c65-d621-441f-a1c9-1e97901e79d2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:30.423607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e7086c65-d621-441f-a1c9-1e97901e79d2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:30.598248 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e7086c65-d621-441f-a1c9-1e97901e79d2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:30.607880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e7086c65-d621-441f-a1c9-1e97901e79d2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.197837 Aug 04 13:57:30.608895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 60/119] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:30 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:30.843134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b505d38c-eba1-48fd-b6b7-f75e37f362a2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:30.844756 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b505d38c-eba1-48fd-b6b7-f75e37f362a2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:30.853534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b505d38c-eba1-48fd-b6b7-f75e37f362a2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:30.853978 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b505d38c-eba1-48fd-b6b7-f75e37f362a2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:30.854952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b505d38c-eba1-48fd-b6b7-f75e37f362a2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:30.855420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b505d38c-eba1-48fd-b6b7-f75e37f362a2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.083981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0e12f78c-29eb-4362-ad83-bdbb8e8f0f00 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.083981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0e12f78c-29eb-4362-ad83-bdbb8e8f0f00 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:31.087035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b505d38c-eba1-48fd-b6b7-f75e37f362a2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.087790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e12f78c-29eb-4362-ad83-bdbb8e8f0f00 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:31.088559 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e12f78c-29eb-4362-ad83-bdbb8e8f0f00 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.089882 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e12f78c-29eb-4362-ad83-bdbb8e8f0f00 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:31.091290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e12f78c-29eb-4362-ad83-bdbb8e8f0f00 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.134561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b505d38c-eba1-48fd-b6b7-f75e37f362a2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.297804 Aug 04 13:57:31.148448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 60/120] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:30 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:31.251346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.251957 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:31.260032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:31.260675 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.261829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:31.262427 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.393553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0e12f78c-29eb-4362-ad83-bdbb8e8f0f00 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.417167 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0e12f78c-29eb-4362-ad83-bdbb8e8f0f00 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.348851 Aug 04 13:57:31.418275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 61/121] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:31 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:31.433303 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dac29064-43c1-4954-a62a-d1a156973ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.434006 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-dac29064-43c1-4954-a62a-d1a156973ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:31.447225 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dac29064-43c1-4954-a62a-d1a156973ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:31.447991 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dac29064-43c1-4954-a62a-d1a156973ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.449694 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dac29064-43c1-4954-a62a-d1a156973ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:31.450340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dac29064-43c1-4954-a62a-d1a156973ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.594976 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.612077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.614826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.617597 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-78b8aaec-78d1-40b6-93e1-db6cd4a152b2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.369612 Aug 04 13:57:31.619278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 61/122] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:31 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:57:31.624672 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fbbbb7be-f644-4d30-9174-f849b65d1e10 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.626048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fbbbb7be-f644-4d30-9174-f849b65d1e10 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:31.644588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbbbb7be-f644-4d30-9174-f849b65d1e10 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:31.646570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbbbb7be-f644-4d30-9174-f849b65d1e10 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.647720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbbbb7be-f644-4d30-9174-f849b65d1e10 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:31.649098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbbbb7be-f644-4d30-9174-f849b65d1e10 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:31.835226 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dac29064-43c1-4954-a62a-d1a156973ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.843573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-dac29064-43c1-4954-a62a-d1a156973ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.423463 Aug 04 13:57:31.844849 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 62/123] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:31 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:31.979840 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fbbbb7be-f644-4d30-9174-f849b65d1e10 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:32.001088 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fbbbb7be-f644-4d30-9174-f849b65d1e10 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.379565 Aug 04 13:57:32.013653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 62/124] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:31 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:32.169187 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f07b5b26-77af-4599-926b-267ead57916d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.170026 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f07b5b26-77af-4599-926b-267ead57916d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:32.180330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f07b5b26-77af-4599-926b-267ead57916d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:32.181422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f07b5b26-77af-4599-926b-267ead57916d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:32.182568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f07b5b26-77af-4599-926b-267ead57916d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:32.183189 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f07b5b26-77af-4599-926b-267ead57916d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:32.439837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7fbc7970-4c1e-49bd-a0aa-a6758c1dbcc7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.441130 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7fbc7970-4c1e-49bd-a0aa-a6758c1dbcc7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:32.460993 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7fbc7970-4c1e-49bd-a0aa-a6758c1dbcc7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:32.462009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7fbc7970-4c1e-49bd-a0aa-a6758c1dbcc7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:32.463459 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7fbc7970-4c1e-49bd-a0aa-a6758c1dbcc7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:32.464458 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7fbc7970-4c1e-49bd-a0aa-a6758c1dbcc7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:32.510461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f07b5b26-77af-4599-926b-267ead57916d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:32.523099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f07b5b26-77af-4599-926b-267ead57916d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.359102 Aug 04 13:57:32.525254 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 63/125] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:32 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:32.652434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.654897 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:32.667099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:32.669649 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:32.671574 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:32.673881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:32.719880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7fbc7970-4c1e-49bd-a0aa-a6758c1dbcc7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:32.736267 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7fbc7970-4c1e-49bd-a0aa-a6758c1dbcc7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.303651 Aug 04 13:57:32.753991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 63/126] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:32 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:32.865997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fc761e63-0d8f-4f99-a0e3-0e7687404298 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.867145 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fc761e63-0d8f-4f99-a0e3-0e7687404298 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:32.879461 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc761e63-0d8f-4f99-a0e3-0e7687404298 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:32.880617 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc761e63-0d8f-4f99-a0e3-0e7687404298 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:32.882116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc761e63-0d8f-4f99-a0e3-0e7687404298 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:32.883179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc761e63-0d8f-4f99-a0e3-0e7687404298 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:33.006058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:33.016242 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:33.017982 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:33.019165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-19cc54ff-cc0d-4c73-85f6-5c2b12412746 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.373757 Aug 04 13:57:33.020990 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 64/127] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:32 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:57:33.038639 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0d21f120-f785-419e-a70e-f77ff27a8940 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:33.039143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0d21f120-f785-419e-a70e-f77ff27a8940 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:33.053368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0d21f120-f785-419e-a70e-f77ff27a8940 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:33.054396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0d21f120-f785-419e-a70e-f77ff27a8940 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:33.056152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0d21f120-f785-419e-a70e-f77ff27a8940 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:33.057109 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0d21f120-f785-419e-a70e-f77ff27a8940 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:33.136103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fc761e63-0d8f-4f99-a0e3-0e7687404298 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:33.158702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fc761e63-0d8f-4f99-a0e3-0e7687404298 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.299208 Aug 04 13:57:33.160119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 64/128] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:32 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:33.379924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0d21f120-f785-419e-a70e-f77ff27a8940 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:33.403595 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0d21f120-f785-419e-a70e-f77ff27a8940 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.380781 Aug 04 13:57:33.409450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 65/129] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:33 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:33.561049 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-803b7b7b-11f1-4c82-88ef-6182b12e5111 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:33.563164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-803b7b7b-11f1-4c82-88ef-6182b12e5111 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:33.579508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-803b7b7b-11f1-4c82-88ef-6182b12e5111 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:33.585533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-803b7b7b-11f1-4c82-88ef-6182b12e5111 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:33.587650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-803b7b7b-11f1-4c82-88ef-6182b12e5111 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:33.594668 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-803b7b7b-11f1-4c82-88ef-6182b12e5111 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:33.764442 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-871984d1-7787-48bc-894d-b1446598922f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:33.765344 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-871984d1-7787-48bc-894d-b1446598922f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:33.773580 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-871984d1-7787-48bc-894d-b1446598922f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:33.774342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-871984d1-7787-48bc-894d-b1446598922f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:33.775459 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-871984d1-7787-48bc-894d-b1446598922f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:33.776066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-871984d1-7787-48bc-894d-b1446598922f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:33.859113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-803b7b7b-11f1-4c82-88ef-6182b12e5111 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:33.873985 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-803b7b7b-11f1-4c82-88ef-6182b12e5111 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.326108 Aug 04 13:57:33.876418 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 65/130] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:33 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:34.056314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:34.060238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:34.077455 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:34.079017 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:34.080421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:34.081120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:34.191762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-871984d1-7787-48bc-894d-b1446598922f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:34.224358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-871984d1-7787-48bc-894d-b1446598922f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.463521 Aug 04 13:57:34.248955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 66/131] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:33 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:34.269609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-35b7582b-c42f-4d44-88a7-b7b155d802d4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:34.271164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-35b7582b-c42f-4d44-88a7-b7b155d802d4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:34.308619 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35b7582b-c42f-4d44-88a7-b7b155d802d4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:34.309971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35b7582b-c42f-4d44-88a7-b7b155d802d4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:34.311785 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35b7582b-c42f-4d44-88a7-b7b155d802d4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:34.315077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35b7582b-c42f-4d44-88a7-b7b155d802d4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:34.387534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:34.414693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:34.424474 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:34.430260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f605cbc0-4686-48dd-81d5-6b582bc1e2bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.381187 Aug 04 13:57:34.441579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 66/132] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:34 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:34.518259 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-eca3e5a0-1c3d-4c1b-8877-8269da8e339f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:34.519588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-eca3e5a0-1c3d-4c1b-8877-8269da8e339f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:34.551280 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eca3e5a0-1c3d-4c1b-8877-8269da8e339f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:34.552331 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eca3e5a0-1c3d-4c1b-8877-8269da8e339f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:34.553959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eca3e5a0-1c3d-4c1b-8877-8269da8e339f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:34.555122 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eca3e5a0-1c3d-4c1b-8877-8269da8e339f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:34.785909 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-eca3e5a0-1c3d-4c1b-8877-8269da8e339f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:34.799678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-eca3e5a0-1c3d-4c1b-8877-8269da8e339f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.336840 Aug 04 13:57:34.803054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 67/133] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:34 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:34.900560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f82bb30a-6c11-4103-bc13-e8d2a8d2d28a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:34.901703 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f82bb30a-6c11-4103-bc13-e8d2a8d2d28a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:34.910526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f82bb30a-6c11-4103-bc13-e8d2a8d2d28a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:34.911265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f82bb30a-6c11-4103-bc13-e8d2a8d2d28a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:34.912411 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f82bb30a-6c11-4103-bc13-e8d2a8d2d28a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:34.912713 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f82bb30a-6c11-4103-bc13-e8d2a8d2d28a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:35.094956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f82bb30a-6c11-4103-bc13-e8d2a8d2d28a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:35.105170 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f82bb30a-6c11-4103-bc13-e8d2a8d2d28a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.208414 Aug 04 13:57:35.115759 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 68/134] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:34 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:35.140195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-35b7582b-c42f-4d44-88a7-b7b155d802d4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:35.155747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-35b7582b-c42f-4d44-88a7-b7b155d802d4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.903904 Aug 04 13:57:35.166677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 67/135] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:34 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:35.267692 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-92816f0d-11a8-4bfc-8c85-bdfb82a3722e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:35.270873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-92816f0d-11a8-4bfc-8c85-bdfb82a3722e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:35.292332 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92816f0d-11a8-4bfc-8c85-bdfb82a3722e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:35.293155 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92816f0d-11a8-4bfc-8c85-bdfb82a3722e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:35.294628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92816f0d-11a8-4bfc-8c85-bdfb82a3722e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:35.295899 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92816f0d-11a8-4bfc-8c85-bdfb82a3722e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:35.466264 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:35.467558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:35.477426 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:35.477877 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:35.478690 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:35.479128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:35.550170 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-92816f0d-11a8-4bfc-8c85-bdfb82a3722e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:35.560817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-92816f0d-11a8-4bfc-8c85-bdfb82a3722e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.300659 Aug 04 13:57:35.563589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 69/136] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:35 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:35.744194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:35.786290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:35.795597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:35.798028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-157d1f3c-d918-4efd-b1c7-9429a646e230 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.335609 Aug 04 13:57:35.799825 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 68/137] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:35 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:57:35.825275 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-139a8b13-12ec-40d0-9fd9-fe4e153e87a1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:35.827132 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-139a8b13-12ec-40d0-9fd9-fe4e153e87a1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:35.849418 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-139a8b13-12ec-40d0-9fd9-fe4e153e87a1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:35.850351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-139a8b13-12ec-40d0-9fd9-fe4e153e87a1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:35.852041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-139a8b13-12ec-40d0-9fd9-fe4e153e87a1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:35.852859 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-139a8b13-12ec-40d0-9fd9-fe4e153e87a1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:36.127200 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b4e5a351-b132-4c75-b56a-9b8db0798ef1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:36.128379 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b4e5a351-b132-4c75-b56a-9b8db0798ef1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:36.159377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4e5a351-b132-4c75-b56a-9b8db0798ef1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:36.160623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4e5a351-b132-4c75-b56a-9b8db0798ef1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:36.162664 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4e5a351-b132-4c75-b56a-9b8db0798ef1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:36.163796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4e5a351-b132-4c75-b56a-9b8db0798ef1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:36.235911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-139a8b13-12ec-40d0-9fd9-fe4e153e87a1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:36.259571 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-139a8b13-12ec-40d0-9fd9-fe4e153e87a1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.442147 Aug 04 13:57:36.274467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 70/138] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:35 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:36.280896 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7f879c61-5ce1-409d-a963-cf62e07c3c70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:36.286326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7f879c61-5ce1-409d-a963-cf62e07c3c70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:36.308168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7f879c61-5ce1-409d-a963-cf62e07c3c70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:36.308881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7f879c61-5ce1-409d-a963-cf62e07c3c70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:36.309861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7f879c61-5ce1-409d-a963-cf62e07c3c70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:36.310445 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7f879c61-5ce1-409d-a963-cf62e07c3c70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:36.665248 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b4e5a351-b132-4c75-b56a-9b8db0798ef1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:36.676716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7f879c61-5ce1-409d-a963-cf62e07c3c70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:36.678644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b4e5a351-b132-4c75-b56a-9b8db0798ef1 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.558189 Aug 04 13:57:36.690271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7f879c61-5ce1-409d-a963-cf62e07c3c70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.412582 Aug 04 13:57:36.691241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 71/139] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:36 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:36.696694 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 69/140] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:36 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:36.721609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-00324a23-f585-46a3-ba5a-927b542876a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:36.725203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-00324a23-f585-46a3-ba5a-927b542876a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:36.740131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-00324a23-f585-46a3-ba5a-927b542876a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:36.741159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-00324a23-f585-46a3-ba5a-927b542876a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:36.743155 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-00324a23-f585-46a3-ba5a-927b542876a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:36.746046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-00324a23-f585-46a3-ba5a-927b542876a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:36.837263 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:36.839285 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:36.862464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:36.862913 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:36.863787 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:36.867190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:37.130754 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.145070 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.147134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.149085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-789c0727-7035-44d8-999b-1eea17145a17 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.328751 Aug 04 13:57:37.149912 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 70/141] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:36 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:37.204653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-00324a23-f585-46a3-ba5a-927b542876a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.212803 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-00324a23-f585-46a3-ba5a-927b542876a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.514045 Aug 04 13:57:37.213403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 72/142] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:36 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:37.284702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-543b1714-3761-493f-b47a-88f770b6272d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:37.285609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-543b1714-3761-493f-b47a-88f770b6272d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:37.293414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-543b1714-3761-493f-b47a-88f770b6272d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:37.293852 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-543b1714-3761-493f-b47a-88f770b6272d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:37.294943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-543b1714-3761-493f-b47a-88f770b6272d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:37.295456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-543b1714-3761-493f-b47a-88f770b6272d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:37.483023 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-543b1714-3761-493f-b47a-88f770b6272d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.492923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-543b1714-3761-493f-b47a-88f770b6272d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.213717 Aug 04 13:57:37.493514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 71/143] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:37 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:37.713653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3c9ca5ee-1930-4233-bcec-8b41052dd89d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:37.714891 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3c9ca5ee-1930-4233-bcec-8b41052dd89d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:37.723251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-163781c4-2a29-474b-8258-04c619dd93e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:37.724565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-163781c4-2a29-474b-8258-04c619dd93e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:37.726592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c9ca5ee-1930-4233-bcec-8b41052dd89d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:37.727278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c9ca5ee-1930-4233-bcec-8b41052dd89d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:37.728315 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c9ca5ee-1930-4233-bcec-8b41052dd89d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:37.728899 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c9ca5ee-1930-4233-bcec-8b41052dd89d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:37.737969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-163781c4-2a29-474b-8258-04c619dd93e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:37.739167 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-163781c4-2a29-474b-8258-04c619dd93e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:37.740847 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-163781c4-2a29-474b-8258-04c619dd93e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:37.742095 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-163781c4-2a29-474b-8258-04c619dd93e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:38.039312 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-163781c4-2a29-474b-8258-04c619dd93e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.055455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-163781c4-2a29-474b-8258-04c619dd93e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.342946 Aug 04 13:57:38.066489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 72/144] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:37 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:38.120011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3c9ca5ee-1930-4233-bcec-8b41052dd89d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.145416 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3c9ca5ee-1930-4233-bcec-8b41052dd89d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.438222 Aug 04 13:57:38.146931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 73/145] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:37 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:38.188635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.192945 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:38.201339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:38.201776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:38.202914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:38.203968 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:38.249185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2f53ced9-b68a-4602-b0a4-3e175e012d1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.250889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2f53ced9-b68a-4602-b0a4-3e175e012d1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:38.263401 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2f53ced9-b68a-4602-b0a4-3e175e012d1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:38.266088 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2f53ced9-b68a-4602-b0a4-3e175e012d1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:38.267519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2f53ced9-b68a-4602-b0a4-3e175e012d1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:38.270815 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2f53ced9-b68a-4602-b0a4-3e175e012d1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:38.477614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.501765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.507457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.509701 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ee2825cc-6c60-453b-9de2-adb097aa8382 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.334881 Aug 04 13:57:38.511134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 73/146] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:38 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:38.518426 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b62ce298-07ed-49c2-a7c5-51c523287973 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.519247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b62ce298-07ed-49c2-a7c5-51c523287973 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:38.533606 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b62ce298-07ed-49c2-a7c5-51c523287973 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:38.534370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b62ce298-07ed-49c2-a7c5-51c523287973 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:38.535801 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b62ce298-07ed-49c2-a7c5-51c523287973 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:38.536592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b62ce298-07ed-49c2-a7c5-51c523287973 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:38.656349 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2f53ced9-b68a-4602-b0a4-3e175e012d1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.666542 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2f53ced9-b68a-4602-b0a4-3e175e012d1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.430234 Aug 04 13:57:38.677239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 74/147] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:38 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:38.824015 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b62ce298-07ed-49c2-a7c5-51c523287973 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.842168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b62ce298-07ed-49c2-a7c5-51c523287973 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.329032 Aug 04 13:57:38.843264 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 74/148] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:38 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:39.087330 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9230c415-b9ef-46b8-9cd5-74f685573448 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.089413 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9230c415-b9ef-46b8-9cd5-74f685573448 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:39.111316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9230c415-b9ef-46b8-9cd5-74f685573448 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.112461 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9230c415-b9ef-46b8-9cd5-74f685573448 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.113893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9230c415-b9ef-46b8-9cd5-74f685573448 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.114655 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9230c415-b9ef-46b8-9cd5-74f685573448 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.170490 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3050cd35-ccc0-4cec-8aea-74beaf501555 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.171227 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3050cd35-ccc0-4cec-8aea-74beaf501555 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:39.179108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3050cd35-ccc0-4cec-8aea-74beaf501555 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.179557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3050cd35-ccc0-4cec-8aea-74beaf501555 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.180394 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3050cd35-ccc0-4cec-8aea-74beaf501555 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.180824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3050cd35-ccc0-4cec-8aea-74beaf501555 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.337603 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3050cd35-ccc0-4cec-8aea-74beaf501555 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:39.349285 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3050cd35-ccc0-4cec-8aea-74beaf501555 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.181799 Aug 04 13:57:39.359000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 75/149] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:39 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:39.403886 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9230c415-b9ef-46b8-9cd5-74f685573448 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:39.412870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9230c415-b9ef-46b8-9cd5-74f685573448 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.340629 Aug 04 13:57:39.413476 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 75/150] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:39 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:39.539178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.540451 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:39.549559 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.550678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.552047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.552997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.728898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:39.746788 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:39.750476 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:39.753846 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-775fac19-35fe-45d6-8440-2e8466344d89 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.220510 Aug 04 13:57:39.755043 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 76/151] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:39 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:39.760378 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9e023ef7-d9ad-4324-a382-45f389f138cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.761078 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9e023ef7-d9ad-4324-a382-45f389f138cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:39.776946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9e023ef7-d9ad-4324-a382-45f389f138cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.777580 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9e023ef7-d9ad-4324-a382-45f389f138cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.778524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9e023ef7-d9ad-4324-a382-45f389f138cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.779365 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9e023ef7-d9ad-4324-a382-45f389f138cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.787572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d8ddd091-58b2-4f9d-93eb-7b2dac008b5d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Action: 'create', calling method: .version_select at 0x7efe7d7adee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1866386038"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:39.825450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-d8ddd091-58b2-4f9d-93eb-7b2dac008b5d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:57:39.835733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-d8ddd091-58b2-4f9d-93eb-7b2dac008b5d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for user 829a37a970b04d14a0b13b5d54ae2f24 and project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:57:39.938735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9e023ef7-d9ad-4324-a382-45f389f138cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:39.949314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9e023ef7-d9ad-4324-a382-45f389f138cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.193212 Aug 04 13:57:39.950303 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 77/152] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:39 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:39.955918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a5e862de-076c-4b48-b894-3f646b0e1159 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.956558 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a5e862de-076c-4b48-b894-3f646b0e1159 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:39.962971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5e862de-076c-4b48-b894-3f646b0e1159 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.963443 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5e862de-076c-4b48-b894-3f646b0e1159 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:39.964256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5e862de-076c-4b48-b894-3f646b0e1159 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:39.964701 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5e862de-076c-4b48-b894-3f646b0e1159 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:40.150847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a5e862de-076c-4b48-b894-3f646b0e1159 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:40.173068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a5e862de-076c-4b48-b894-3f646b0e1159 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.214562 Aug 04 13:57:40.173068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 78/153] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:39 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:40.372892 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3a9aeaa4-7619-4b50-97b7-7fffd04d26b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:40.376022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3a9aeaa4-7619-4b50-97b7-7fffd04d26b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:40.387394 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3a9aeaa4-7619-4b50-97b7-7fffd04d26b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:40.388102 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3a9aeaa4-7619-4b50-97b7-7fffd04d26b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:40.389798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3a9aeaa4-7619-4b50-97b7-7fffd04d26b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:40.390593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3a9aeaa4-7619-4b50-97b7-7fffd04d26b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:40.393440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-d8ddd091-58b2-4f9d-93eb-7b2dac008b5d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:57:40.401812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-d8ddd091-58b2-4f9d-93eb-7b2dac008b5d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for user 829a37a970b04d14a0b13b5d54ae2f24 and project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:57:40.427367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d8ddd091-58b2-4f9d-93eb-7b2dac008b5d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.940380 Aug 04 13:57:40.429119 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 76/154] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Aug 4 13:57:39 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:40.459214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-504db7dd-8238-4f5a-92eb-c08cd4aeaf16 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:40.460856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-504db7dd-8238-4f5a-92eb-c08cd4aeaf16 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:40.478661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-504db7dd-8238-4f5a-92eb-c08cd4aeaf16 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:40.479272 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-504db7dd-8238-4f5a-92eb-c08cd4aeaf16 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:40.480410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-504db7dd-8238-4f5a-92eb-c08cd4aeaf16 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:40.481051 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-504db7dd-8238-4f5a-92eb-c08cd4aeaf16 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:40.628135 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3a9aeaa4-7619-4b50-97b7-7fffd04d26b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:40.648310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3a9aeaa4-7619-4b50-97b7-7fffd04d26b0 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.280898 Aug 04 13:57:40.649394 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 79/155] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:40 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:40.760333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-504db7dd-8238-4f5a-92eb-c08cd4aeaf16 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:40.771114 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-504db7dd-8238-4f5a-92eb-c08cd4aeaf16 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.335657 Aug 04 13:57:40.772510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 77/156] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:40 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:40.789306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:40.789777 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:40.799291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:40.800022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:40.801186 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:40.802338 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:40.973209 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1f76ea9f-13d3-429d-a7d2-5480ff281c9d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:40.974119 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1f76ea9f-13d3-429d-a7d2-5480ff281c9d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:40.986088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f76ea9f-13d3-429d-a7d2-5480ff281c9d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:40.986935 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f76ea9f-13d3-429d-a7d2-5480ff281c9d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:40.988579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f76ea9f-13d3-429d-a7d2-5480ff281c9d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:40.990908 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f76ea9f-13d3-429d-a7d2-5480ff281c9d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:41.039052 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:41.051475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:41.053335 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:41.054750 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ce38f94d-94c9-4aff-b00b-d6dab75deb0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.269713 Aug 04 13:57:41.056818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 80/157] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:40 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:41.168334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1f76ea9f-13d3-429d-a7d2-5480ff281c9d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:41.179289 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1f76ea9f-13d3-429d-a7d2-5480ff281c9d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.212229 Aug 04 13:57:41.184311 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 78/158] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:40 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:41.190421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9d9fa623-9058-4863-a455-2adc5386f09d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:41.191439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9d9fa623-9058-4863-a455-2adc5386f09d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:41.200926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d9fa623-9058-4863-a455-2adc5386f09d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:41.201556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d9fa623-9058-4863-a455-2adc5386f09d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:41.202489 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d9fa623-9058-4863-a455-2adc5386f09d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:41.204328 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d9fa623-9058-4863-a455-2adc5386f09d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:41.505847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9d9fa623-9058-4863-a455-2adc5386f09d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:41.530123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9d9fa623-9058-4863-a455-2adc5386f09d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.347735 Aug 04 13:57:41.537792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 81/159] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:41 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:41.675419 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a0b7bb92-93c4-4b05-aeca-aecf980acfc9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:41.676053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a0b7bb92-93c4-4b05-aeca-aecf980acfc9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:41.684038 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0b7bb92-93c4-4b05-aeca-aecf980acfc9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:41.684830 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0b7bb92-93c4-4b05-aeca-aecf980acfc9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:41.685994 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0b7bb92-93c4-4b05-aeca-aecf980acfc9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:41.686649 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0b7bb92-93c4-4b05-aeca-aecf980acfc9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:41.796049 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f0a40375-c855-460f-adfd-cfc5dfe99af7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:41.801519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f0a40375-c855-460f-adfd-cfc5dfe99af7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:41.817475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0a40375-c855-460f-adfd-cfc5dfe99af7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:41.818325 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0a40375-c855-460f-adfd-cfc5dfe99af7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:41.819512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0a40375-c855-460f-adfd-cfc5dfe99af7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:41.820294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0a40375-c855-460f-adfd-cfc5dfe99af7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:41.917883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a0b7bb92-93c4-4b05-aeca-aecf980acfc9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:41.932954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a0b7bb92-93c4-4b05-aeca-aecf980acfc9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.262721 Aug 04 13:57:41.933920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 79/160] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:41 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:42.082430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.084928 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:42.094678 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:42.095422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:42.096533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:42.097033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:42.102546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f0a40375-c855-460f-adfd-cfc5dfe99af7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:42.117485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f0a40375-c855-460f-adfd-cfc5dfe99af7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.329609 Aug 04 13:57:42.132898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 82/161] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:41 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:42.213789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9c53ed3e-2c15-4329-9743-cf0dfa5b110a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.215719 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9c53ed3e-2c15-4329-9743-cf0dfa5b110a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:42.233180 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c53ed3e-2c15-4329-9743-cf0dfa5b110a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:42.233903 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c53ed3e-2c15-4329-9743-cf0dfa5b110a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:42.235899 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c53ed3e-2c15-4329-9743-cf0dfa5b110a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:42.236490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c53ed3e-2c15-4329-9743-cf0dfa5b110a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:42.323358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:42.337572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:42.339487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:42.340784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bce68e38-8ac4-45fe-872c-d5e8967f795f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.267044 Aug 04 13:57:42.341625 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 80/162] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:42 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:42.517987 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9c53ed3e-2c15-4329-9743-cf0dfa5b110a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:42.527391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9c53ed3e-2c15-4329-9743-cf0dfa5b110a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.322382 Aug 04 13:57:42.527946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 83/163] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:42 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:42.585495 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-502d0a70-1f47-4706-82ff-0574a387f39a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.586243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-502d0a70-1f47-4706-82ff-0574a387f39a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:42.592983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-502d0a70-1f47-4706-82ff-0574a387f39a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:42.593658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-502d0a70-1f47-4706-82ff-0574a387f39a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:42.595898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-502d0a70-1f47-4706-82ff-0574a387f39a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:42.596680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-502d0a70-1f47-4706-82ff-0574a387f39a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:42.761150 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-502d0a70-1f47-4706-82ff-0574a387f39a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:42.769899 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-502d0a70-1f47-4706-82ff-0574a387f39a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.205195 Aug 04 13:57:42.770744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 81/164] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:42 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:42.970327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6e0533b3-02d1-4a16-ac5e-e59d7ce54ae3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.971254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6e0533b3-02d1-4a16-ac5e-e59d7ce54ae3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:42.980311 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6e0533b3-02d1-4a16-ac5e-e59d7ce54ae3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:42.980998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6e0533b3-02d1-4a16-ac5e-e59d7ce54ae3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:42.983301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6e0533b3-02d1-4a16-ac5e-e59d7ce54ae3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:42.984752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6e0533b3-02d1-4a16-ac5e-e59d7ce54ae3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:43.145981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-052c86b5-c2fb-4c1d-b3e3-45535d6b455f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:43.149355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-052c86b5-c2fb-4c1d-b3e3-45535d6b455f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:43.167761 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-052c86b5-c2fb-4c1d-b3e3-45535d6b455f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:43.168306 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-052c86b5-c2fb-4c1d-b3e3-45535d6b455f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:43.169216 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-052c86b5-c2fb-4c1d-b3e3-45535d6b455f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:43.169652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-052c86b5-c2fb-4c1d-b3e3-45535d6b455f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:43.235706 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6e0533b3-02d1-4a16-ac5e-e59d7ce54ae3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:43.259617 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6e0533b3-02d1-4a16-ac5e-e59d7ce54ae3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.291037 Aug 04 13:57:43.260570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 84/165] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:42 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:43.353387 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-052c86b5-c2fb-4c1d-b3e3-45535d6b455f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:43.366413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-052c86b5-c2fb-4c1d-b3e3-45535d6b455f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.226184 Aug 04 13:57:43.370719 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:43.371708 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:43.379528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 82/166] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:43 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:43.384866 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:43.385274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:43.386106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:43.386593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:43.552469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b800b78-26e7-44a3-bdfe-a849580ad327 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:43.553662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b800b78-26e7-44a3-bdfe-a849580ad327 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:43.565486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b800b78-26e7-44a3-bdfe-a849580ad327 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:43.566135 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b800b78-26e7-44a3-bdfe-a849580ad327 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:43.567173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b800b78-26e7-44a3-bdfe-a849580ad327 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:43.567748 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b800b78-26e7-44a3-bdfe-a849580ad327 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:43.630320 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:43.645057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:43.648753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:43.651780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ae78515c-bbd0-4218-9be2-b8d3aa554119 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.285024 Aug 04 13:57:43.658335 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 85/167] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:43 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:57:43.778171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1b800b78-26e7-44a3-bdfe-a849580ad327 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:43.787977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-250f93a8-0449-450a-9022-8dcc220a120a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:43.789366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-250f93a8-0449-450a-9022-8dcc220a120a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:43.790750 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b800b78-26e7-44a3-bdfe-a849580ad327 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.247498 Aug 04 13:57:43.792809 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 83/168] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:43 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:43.799665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-250f93a8-0449-450a-9022-8dcc220a120a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:43.799842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-250f93a8-0449-450a-9022-8dcc220a120a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:43.800682 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-250f93a8-0449-450a-9022-8dcc220a120a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:43.801330 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-250f93a8-0449-450a-9022-8dcc220a120a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:44.173907 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-250f93a8-0449-450a-9022-8dcc220a120a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:44.200415 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-250f93a8-0449-450a-9022-8dcc220a120a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.415960 Aug 04 13:57:44.217406 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 86/169] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:43 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:44.290779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1565faa7-51f8-4350-bdec-7250f828f611 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:44.292042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1565faa7-51f8-4350-bdec-7250f828f611 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:44.309610 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1565faa7-51f8-4350-bdec-7250f828f611 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:44.310312 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1565faa7-51f8-4350-bdec-7250f828f611 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:44.311728 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1565faa7-51f8-4350-bdec-7250f828f611 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:44.312544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1565faa7-51f8-4350-bdec-7250f828f611 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:44.390232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-70d0cf98-d5f0-4e48-960c-78c0b7f7e2ca tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:44.392395 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-70d0cf98-d5f0-4e48-960c-78c0b7f7e2ca tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:44.401903 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70d0cf98-d5f0-4e48-960c-78c0b7f7e2ca tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:44.402355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70d0cf98-d5f0-4e48-960c-78c0b7f7e2ca tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:44.403154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70d0cf98-d5f0-4e48-960c-78c0b7f7e2ca tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:44.403587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70d0cf98-d5f0-4e48-960c-78c0b7f7e2ca tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:44.601731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1565faa7-51f8-4350-bdec-7250f828f611 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:44.620616 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1565faa7-51f8-4350-bdec-7250f828f611 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.341341 Aug 04 13:57:44.644790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 84/170] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:44 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:44.697876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:44.699444 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:44.720289 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:44.720747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:44.721537 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:44.721965 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:44.794702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-70d0cf98-d5f0-4e48-960c-78c0b7f7e2ca tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:44.801740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-70d0cf98-d5f0-4e48-960c-78c0b7f7e2ca tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.417273 Aug 04 13:57:44.802330 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 87/171] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:44 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:44.811772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d0dea7c7-2372-465a-8898-3d7ea9aef6e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:44.816131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d0dea7c7-2372-465a-8898-3d7ea9aef6e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:44.838073 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0dea7c7-2372-465a-8898-3d7ea9aef6e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:44.838543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0dea7c7-2372-465a-8898-3d7ea9aef6e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:44.840089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0dea7c7-2372-465a-8898-3d7ea9aef6e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:44.840575 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0dea7c7-2372-465a-8898-3d7ea9aef6e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:45.041296 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:45.051403 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:45.054504 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:45.056926 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fce166e8-d913-45ba-9f3a-773bd7cf1958 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.366044 Aug 04 13:57:45.058094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 85/172] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:44 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:45.061386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d0dea7c7-2372-465a-8898-3d7ea9aef6e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:45.073508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d0dea7c7-2372-465a-8898-3d7ea9aef6e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.267909 Aug 04 13:57:45.083803 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 88/173] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:44 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:45.228796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e04b386d-2e00-496b-80b9-d5f06065d2a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:45.229410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e04b386d-2e00-496b-80b9-d5f06065d2a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:45.236544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e04b386d-2e00-496b-80b9-d5f06065d2a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:45.236988 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e04b386d-2e00-496b-80b9-d5f06065d2a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:45.237766 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e04b386d-2e00-496b-80b9-d5f06065d2a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:45.238482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e04b386d-2e00-496b-80b9-d5f06065d2a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:45.622433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e04b386d-2e00-496b-80b9-d5f06065d2a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:45.643560 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e04b386d-2e00-496b-80b9-d5f06065d2a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.417962 Aug 04 13:57:45.656509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-291cb4ab-4d58-44f5-bde0-0f67335667f9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:45.657628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-291cb4ab-4d58-44f5-bde0-0f67335667f9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:45.675731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 86/174] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:45 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:45.678062 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-291cb4ab-4d58-44f5-bde0-0f67335667f9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:45.678700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-291cb4ab-4d58-44f5-bde0-0f67335667f9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:45.679673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-291cb4ab-4d58-44f5-bde0-0f67335667f9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:45.680291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-291cb4ab-4d58-44f5-bde0-0f67335667f9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:45.833171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-33b238cd-82c8-4bbf-bf7b-7c5ab2e9abdb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:45.833692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-33b238cd-82c8-4bbf-bf7b-7c5ab2e9abdb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:45.842279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33b238cd-82c8-4bbf-bf7b-7c5ab2e9abdb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:45.842827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33b238cd-82c8-4bbf-bf7b-7c5ab2e9abdb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:45.844483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33b238cd-82c8-4bbf-bf7b-7c5ab2e9abdb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:45.845281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33b238cd-82c8-4bbf-bf7b-7c5ab2e9abdb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:45.861513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-291cb4ab-4d58-44f5-bde0-0f67335667f9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:45.871526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-291cb4ab-4d58-44f5-bde0-0f67335667f9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.222656 Aug 04 13:57:45.872403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 89/175] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:45 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:45.991500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-33b238cd-82c8-4bbf-bf7b-7c5ab2e9abdb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:46.005412 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-33b238cd-82c8-4bbf-bf7b-7c5ab2e9abdb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.176720 Aug 04 13:57:46.006491 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 87/176] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:45 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:46.088766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:46.089258 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:46.096121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.096944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.097942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.098572 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.101967 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-916510a2-11ce-454e-b287-ecaf758e516c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:46.103719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-916510a2-11ce-454e-b287-ecaf758e516c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:46.125788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-916510a2-11ce-454e-b287-ecaf758e516c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.129532 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-916510a2-11ce-454e-b287-ecaf758e516c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.130610 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-916510a2-11ce-454e-b287-ecaf758e516c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.131336 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-916510a2-11ce-454e-b287-ecaf758e516c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.263224 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:46.285081 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:46.289456 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:46.291780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ef35c156-390d-43b3-876e-8c63d830ad92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.206835 Aug 04 13:57:46.304108 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 90/177] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:46 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:57:46.310471 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-916510a2-11ce-454e-b287-ecaf758e516c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:46.331770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-916510a2-11ce-454e-b287-ecaf758e516c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.243608 Aug 04 13:57:46.332858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 88/178] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:46 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:46.572483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-0e42a9f4-1273-4046-a0da-d6ee62e21d67 req-113f89a0-3f51-4503-9045-a21df9d2bfc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393f6f8-d997-4def-9ada-9df175d346be", "name": "network-vif-plugged", "status": "completed", "tag": "7e794fec-4d42-4e16-a581-d3659230bffe"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:46.575543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:46.575543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:57:46.584598 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-0e42a9f4-1273-4046-a0da-d6ee62e21d67 req-113f89a0-3f51-4503-9045-a21df9d2bfc1 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.584977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-0e42a9f4-1273-4046-a0da-d6ee62e21d67 req-113f89a0-3f51-4503-9045-a21df9d2bfc1 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.597431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-0e42a9f4-1273-4046-a0da-d6ee62e21d67 req-113f89a0-3f51-4503-9045-a21df9d2bfc1 service nova] Creating event network-vif-plugged:7e794fec-4d42-4e16-a581-d3659230bffe for instance 5393f6f8-d997-4def-9ada-9df175d346be on hv-cinder-79264 Aug 04 13:57:46.603056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-0e42a9f4-1273-4046-a0da-d6ee62e21d67 req-113f89a0-3f51-4503-9045-a21df9d2bfc1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104728 Aug 04 13:57:46.603769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 91/179] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:46.705108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1124541d-19c3-4b32-ba1a-f6f9d3142831 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:46.705953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1124541d-19c3-4b32-ba1a-f6f9d3142831 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:46.714443 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1124541d-19c3-4b32-ba1a-f6f9d3142831 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.715451 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1124541d-19c3-4b32-ba1a-f6f9d3142831 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.718622 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1124541d-19c3-4b32-ba1a-f6f9d3142831 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.720159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1124541d-19c3-4b32-ba1a-f6f9d3142831 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.890781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e77f0197-148a-41fe-b377-4534cb2662af tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:46.891408 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e77f0197-148a-41fe-b377-4534cb2662af tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:46.895764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1124541d-19c3-4b32-ba1a-f6f9d3142831 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:46.899719 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e77f0197-148a-41fe-b377-4534cb2662af tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.900274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e77f0197-148a-41fe-b377-4534cb2662af tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.901129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e77f0197-148a-41fe-b377-4534cb2662af tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:46.901593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e77f0197-148a-41fe-b377-4534cb2662af tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:46.904082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1124541d-19c3-4b32-ba1a-f6f9d3142831 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.204771 Aug 04 13:57:46.904698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 89/180] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:46 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:47.028899 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-518531df-2227-48b9-bb79-fa9af64db178 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:47.030060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-518531df-2227-48b9-bb79-fa9af64db178 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:47.039679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-518531df-2227-48b9-bb79-fa9af64db178 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:47.040303 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-518531df-2227-48b9-bb79-fa9af64db178 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:47.041681 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-518531df-2227-48b9-bb79-fa9af64db178 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:47.042534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-518531df-2227-48b9-bb79-fa9af64db178 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:47.049583 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e77f0197-148a-41fe-b377-4534cb2662af tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:47.057255 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e77f0197-148a-41fe-b377-4534cb2662af tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.170810 Aug 04 13:57:47.057844 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 92/181] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:46 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:47.192762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-518531df-2227-48b9-bb79-fa9af64db178 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:47.200646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-518531df-2227-48b9-bb79-fa9af64db178 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.177288 Aug 04 13:57:47.201232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 90/182] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:47 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:47.311739 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:47.312856 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:47.319332 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:47.319780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:47.320628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:47.321339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:47.350937 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1a7672f5-d040-4a16-809e-983c68919c5a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:47.351550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1a7672f5-d040-4a16-809e-983c68919c5a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:47.361071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a7672f5-d040-4a16-809e-983c68919c5a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:47.361833 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a7672f5-d040-4a16-809e-983c68919c5a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:47.362807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a7672f5-d040-4a16-809e-983c68919c5a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:47.363410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a7672f5-d040-4a16-809e-983c68919c5a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:47.483140 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:47.493550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:47.495338 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:47.496123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ed8455d6-2b50-4557-9998-da7e9d05ed88 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.188187 Aug 04 13:57:47.502827 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 93/183] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:47 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:47.512435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1a7672f5-d040-4a16-809e-983c68919c5a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:47.526930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1a7672f5-d040-4a16-809e-983c68919c5a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.179798 Aug 04 13:57:47.527985 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 91/184] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:47 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:47.921435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d89b873e-acab-4868-8273-b09b4730883d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:47.922321 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d89b873e-acab-4868-8273-b09b4730883d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:47.928540 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b873e-acab-4868-8273-b09b4730883d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:47.928988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b873e-acab-4868-8273-b09b4730883d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:47.929786 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b873e-acab-4868-8273-b09b4730883d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:47.930237 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b873e-acab-4868-8273-b09b4730883d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.076838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-731518ac-eda2-40f8-9f63-05f39493908e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:48.077439 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-731518ac-eda2-40f8-9f63-05f39493908e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:48.083225 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d89b873e-acab-4868-8273-b09b4730883d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:48.083812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-731518ac-eda2-40f8-9f63-05f39493908e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.084676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-731518ac-eda2-40f8-9f63-05f39493908e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.085666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-731518ac-eda2-40f8-9f63-05f39493908e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.086144 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-731518ac-eda2-40f8-9f63-05f39493908e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.091761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d89b873e-acab-4868-8273-b09b4730883d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.173888 Aug 04 13:57:48.092380 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 94/185] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:47 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:48.219857 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-83a4e1a3-2a6f-4991-b0a8-e62e77311d74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:48.220564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-83a4e1a3-2a6f-4991-b0a8-e62e77311d74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:48.222106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-731518ac-eda2-40f8-9f63-05f39493908e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:48.226490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-83a4e1a3-2a6f-4991-b0a8-e62e77311d74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.226926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-83a4e1a3-2a6f-4991-b0a8-e62e77311d74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.227699 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-83a4e1a3-2a6f-4991-b0a8-e62e77311d74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.228120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-83a4e1a3-2a6f-4991-b0a8-e62e77311d74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.229375 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-731518ac-eda2-40f8-9f63-05f39493908e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.156296 Aug 04 13:57:48.229926 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 92/186] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:48 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:48.371071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-83a4e1a3-2a6f-4991-b0a8-e62e77311d74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:48.380047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-83a4e1a3-2a6f-4991-b0a8-e62e77311d74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.164854 Aug 04 13:57:48.380666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 95/187] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:48 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:48.525283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:48.525880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:48.532464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.532903 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.533657 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.534077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.544764 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d4814185-1630-4527-a3b1-4c31c52bab35 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:48.545397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d4814185-1630-4527-a3b1-4c31c52bab35 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:48.552348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d4814185-1630-4527-a3b1-4c31c52bab35 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.552828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d4814185-1630-4527-a3b1-4c31c52bab35 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.553677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d4814185-1630-4527-a3b1-4c31c52bab35 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.554110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d4814185-1630-4527-a3b1-4c31c52bab35 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.666995 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:48.677959 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:48.679666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:48.680873 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cd9c181a-739c-4481-b245-1f8bacea69a0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.159508 Aug 04 13:57:48.681672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 93/188] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:48 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:48.686434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-49fb357a-8577-4dbb-8861-9f2e1b9d184e req-51d631c4-8423-4b6d-a506-afca37e02c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9793c85c-8440-4767-a627-2ff4c2c559a2", "name": "network-vif-plugged", "status": "completed", "tag": "33fe8983-4030-4984-8c31-c7cfa77508c5"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:48.689009 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:48.689009 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:57:48.697616 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-49fb357a-8577-4dbb-8861-9f2e1b9d184e req-51d631c4-8423-4b6d-a506-afca37e02c9b service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:48.698060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-49fb357a-8577-4dbb-8861-9f2e1b9d184e req-51d631c4-8423-4b6d-a506-afca37e02c9b service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:48.710939 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-49fb357a-8577-4dbb-8861-9f2e1b9d184e req-51d631c4-8423-4b6d-a506-afca37e02c9b service nova] Creating event network-vif-plugged:33fe8983-4030-4984-8c31-c7cfa77508c5 for instance 9793c85c-8440-4767-a627-2ff4c2c559a2 on hv-cinder-79264 Aug 04 13:57:48.716357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-49fb357a-8577-4dbb-8861-9f2e1b9d184e req-51d631c4-8423-4b6d-a506-afca37e02c9b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033284 Aug 04 13:57:48.717144 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 94/189] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:48.728889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d4814185-1630-4527-a3b1-4c31c52bab35 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:48.738393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d4814185-1630-4527-a3b1-4c31c52bab35 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.197274 Aug 04 13:57:48.739002 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 96/190] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:48 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:49.110907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-31ea4b72-dd4f-43ae-b3af-b267d871c4dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:49.111606 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-31ea4b72-dd4f-43ae-b3af-b267d871c4dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:49.118323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31ea4b72-dd4f-43ae-b3af-b267d871c4dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.118765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31ea4b72-dd4f-43ae-b3af-b267d871c4dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.119543 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31ea4b72-dd4f-43ae-b3af-b267d871c4dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.119971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31ea4b72-dd4f-43ae-b3af-b267d871c4dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.256085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c3c7046d-496f-47d1-a31b-ad63ac55373a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:49.256933 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c3c7046d-496f-47d1-a31b-ad63ac55373a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:49.265652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-31ea4b72-dd4f-43ae-b3af-b267d871c4dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:49.268389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c3c7046d-496f-47d1-a31b-ad63ac55373a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.269140 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c3c7046d-496f-47d1-a31b-ad63ac55373a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.270380 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c3c7046d-496f-47d1-a31b-ad63ac55373a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.271102 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c3c7046d-496f-47d1-a31b-ad63ac55373a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.275707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-31ea4b72-dd4f-43ae-b3af-b267d871c4dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.169567 Aug 04 13:57:49.276322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 95/191] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:49 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:49.409249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-42bc0ac8-ba87-4998-aeec-d389c5e470b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:49.410483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-42bc0ac8-ba87-4998-aeec-d389c5e470b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:49.420964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42bc0ac8-ba87-4998-aeec-d389c5e470b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.421913 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42bc0ac8-ba87-4998-aeec-d389c5e470b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.423085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42bc0ac8-ba87-4998-aeec-d389c5e470b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.423597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42bc0ac8-ba87-4998-aeec-d389c5e470b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.466724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c3c7046d-496f-47d1-a31b-ad63ac55373a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:49.479258 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c3c7046d-496f-47d1-a31b-ad63ac55373a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.234700 Aug 04 13:57:49.480202 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 97/192] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:49 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:49.568580 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-42bc0ac8-ba87-4998-aeec-d389c5e470b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:49.576709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-42bc0ac8-ba87-4998-aeec-d389c5e470b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.176303 Aug 04 13:57:49.577294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 96/193] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:49 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:49.701729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:49.702348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:49.709194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.709637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.710433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.710867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.756113 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-374b5eb8-7e81-4b1c-a8f7-f0e5b4964a7a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:49.756748 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-374b5eb8-7e81-4b1c-a8f7-f0e5b4964a7a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:49.762946 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-374b5eb8-7e81-4b1c-a8f7-f0e5b4964a7a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.763505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-374b5eb8-7e81-4b1c-a8f7-f0e5b4964a7a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.764458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-374b5eb8-7e81-4b1c-a8f7-f0e5b4964a7a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:49.765122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-374b5eb8-7e81-4b1c-a8f7-f0e5b4964a7a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:49.861137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:49.869958 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:49.871617 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:49.872765 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cb581751-dd92-4886-958e-b6521ed45aa2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.174890 Aug 04 13:57:49.873345 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 98/194] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:49 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:49.913353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-374b5eb8-7e81-4b1c-a8f7-f0e5b4964a7a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:49.921347 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-374b5eb8-7e81-4b1c-a8f7-f0e5b4964a7a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.169305 Aug 04 13:57:49.922601 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 97/195] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:49 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:50.295157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e866d322-b7db-4cad-b5f4-13b33b2b39ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.295862 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e866d322-b7db-4cad-b5f4-13b33b2b39ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:50.303336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e866d322-b7db-4cad-b5f4-13b33b2b39ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.303842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e866d322-b7db-4cad-b5f4-13b33b2b39ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.304722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e866d322-b7db-4cad-b5f4-13b33b2b39ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.305144 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e866d322-b7db-4cad-b5f4-13b33b2b39ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.487348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e866d322-b7db-4cad-b5f4-13b33b2b39ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:50.496137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e866d322-b7db-4cad-b5f4-13b33b2b39ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.204659 Aug 04 13:57:50.497259 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 99/196] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:50 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:50.499487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7589b21f-5f90-42f0-80fc-33443d3a61f3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.501143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7589b21f-5f90-42f0-80fc-33443d3a61f3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:50.511259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7589b21f-5f90-42f0-80fc-33443d3a61f3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.511712 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7589b21f-5f90-42f0-80fc-33443d3a61f3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.512829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7589b21f-5f90-42f0-80fc-33443d3a61f3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.513372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7589b21f-5f90-42f0-80fc-33443d3a61f3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.599523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ca1b8115-ec9a-4d2d-ad0f-82f1e10295e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.600502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ca1b8115-ec9a-4d2d-ad0f-82f1e10295e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:50.608362 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca1b8115-ec9a-4d2d-ad0f-82f1e10295e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.608362 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca1b8115-ec9a-4d2d-ad0f-82f1e10295e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.608991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca1b8115-ec9a-4d2d-ad0f-82f1e10295e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.609442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca1b8115-ec9a-4d2d-ad0f-82f1e10295e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.657538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7589b21f-5f90-42f0-80fc-33443d3a61f3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:50.670774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7589b21f-5f90-42f0-80fc-33443d3a61f3 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.176680 Aug 04 13:57:50.672089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 98/197] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:50 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:50.768354 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ca1b8115-ec9a-4d2d-ad0f-82f1e10295e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:50.778872 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ca1b8115-ec9a-4d2d-ad0f-82f1e10295e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.187120 Aug 04 13:57:50.779483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 100/198] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:50 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:50.897733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.898798 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:50.906920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.907695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.908595 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.909046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.939969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d563d133-741e-407b-b723-b4c9ee8b1694 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.940591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d563d133-741e-407b-b723-b4c9ee8b1694 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:50.947550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d563d133-741e-407b-b723-b4c9ee8b1694 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.948122 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d563d133-741e-407b-b723-b4c9ee8b1694 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:50.949107 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d563d133-741e-407b-b723-b4c9ee8b1694 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:50.949769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d563d133-741e-407b-b723-b4c9ee8b1694 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:51.059848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:51.070784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:51.072658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:51.073761 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0df57e7c-1bf5-41cc-9b2a-4083a856b830 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.179819 Aug 04 13:57:51.074521 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 99/199] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:50 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:51.096697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d563d133-741e-407b-b723-b4c9ee8b1694 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:51.109912 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d563d133-741e-407b-b723-b4c9ee8b1694 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.172818 Aug 04 13:57:51.110359 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 101/200] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:50 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:51.515935 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-17275be6-524f-44cd-bbe1-4e0ee514ba6f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:51.517057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-17275be6-524f-44cd-bbe1-4e0ee514ba6f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:51.524224 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-17275be6-524f-44cd-bbe1-4e0ee514ba6f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:51.524672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-17275be6-524f-44cd-bbe1-4e0ee514ba6f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:51.525445 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-17275be6-524f-44cd-bbe1-4e0ee514ba6f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:51.525876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-17275be6-524f-44cd-bbe1-4e0ee514ba6f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:51.670511 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-17275be6-524f-44cd-bbe1-4e0ee514ba6f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:51.679082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-17275be6-524f-44cd-bbe1-4e0ee514ba6f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.168004 Aug 04 13:57:51.679686 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 100/201] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:51 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:51.693594 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-58946150-aeaa-48c2-87ad-db8751fa478e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:51.694676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-58946150-aeaa-48c2-87ad-db8751fa478e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:51.704523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-58946150-aeaa-48c2-87ad-db8751fa478e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:51.705084 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-58946150-aeaa-48c2-87ad-db8751fa478e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:51.706447 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-58946150-aeaa-48c2-87ad-db8751fa478e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:51.707163 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-58946150-aeaa-48c2-87ad-db8751fa478e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:51.805268 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d54a20c4-5ce0-48fa-9e09-44b0c9d7011c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:51.805881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d54a20c4-5ce0-48fa-9e09-44b0c9d7011c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:51.812607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d54a20c4-5ce0-48fa-9e09-44b0c9d7011c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:51.813187 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d54a20c4-5ce0-48fa-9e09-44b0c9d7011c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:51.814032 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d54a20c4-5ce0-48fa-9e09-44b0c9d7011c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:51.814465 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d54a20c4-5ce0-48fa-9e09-44b0c9d7011c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:51.876863 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-58946150-aeaa-48c2-87ad-db8751fa478e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:51.891502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-58946150-aeaa-48c2-87ad-db8751fa478e tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.204829 Aug 04 13:57:51.892658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 102/202] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:51 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:51.960950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d54a20c4-5ce0-48fa-9e09-44b0c9d7011c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:51.971080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d54a20c4-5ce0-48fa-9e09-44b0c9d7011c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.170615 Aug 04 13:57:51.971710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 101/203] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:51 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:52.095835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:52.096589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:52.102861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.103299 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.104538 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.104538 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.129545 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a836dad1-b428-4837-a2d1-04c18bbc18f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:52.130068 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a836dad1-b428-4837-a2d1-04c18bbc18f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:52.136984 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a836dad1-b428-4837-a2d1-04c18bbc18f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.137497 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a836dad1-b428-4837-a2d1-04c18bbc18f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.138339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a836dad1-b428-4837-a2d1-04c18bbc18f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.139220 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a836dad1-b428-4837-a2d1-04c18bbc18f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.266026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:52.274634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:52.276519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:52.277661 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-74ad2b49-f4db-428b-8f91-62d0fddd9308 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.188091 Aug 04 13:57:52.278606 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 103/204] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:52 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:52.287431 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a836dad1-b428-4837-a2d1-04c18bbc18f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:52.295416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a836dad1-b428-4837-a2d1-04c18bbc18f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.171990 Aug 04 13:57:52.296002 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 102/205] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:52 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:52.698571 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7469581f-65db-4c71-a7e1-1ca9e8b3f26b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:52.699212 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7469581f-65db-4c71-a7e1-1ca9e8b3f26b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:52.705400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7469581f-65db-4c71-a7e1-1ca9e8b3f26b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.705846 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7469581f-65db-4c71-a7e1-1ca9e8b3f26b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.706623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7469581f-65db-4c71-a7e1-1ca9e8b3f26b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.707056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7469581f-65db-4c71-a7e1-1ca9e8b3f26b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.847465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7469581f-65db-4c71-a7e1-1ca9e8b3f26b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:52.854721 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7469581f-65db-4c71-a7e1-1ca9e8b3f26b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.161525 Aug 04 13:57:52.855298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 104/206] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:52 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:52.910145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d1d193b2-34c3-494a-9d1e-2362cd88e9f8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:52.910749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d1d193b2-34c3-494a-9d1e-2362cd88e9f8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:52.917699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d1d193b2-34c3-494a-9d1e-2362cd88e9f8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.918148 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d1d193b2-34c3-494a-9d1e-2362cd88e9f8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.918927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d1d193b2-34c3-494a-9d1e-2362cd88e9f8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.919355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d1d193b2-34c3-494a-9d1e-2362cd88e9f8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.990273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-71daca4a-d248-46d5-999f-7631ae96030a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:52.991014 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-71daca4a-d248-46d5-999f-7631ae96030a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:52.996808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71daca4a-d248-46d5-999f-7631ae96030a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.997246 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71daca4a-d248-46d5-999f-7631ae96030a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:52.998011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71daca4a-d248-46d5-999f-7631ae96030a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:52.998434 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71daca4a-d248-46d5-999f-7631ae96030a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:53.053469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d1d193b2-34c3-494a-9d1e-2362cd88e9f8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:53.061051 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d1d193b2-34c3-494a-9d1e-2362cd88e9f8 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.154478 Aug 04 13:57:53.061543 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 103/207] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:52 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:53.134214 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-71daca4a-d248-46d5-999f-7631ae96030a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:53.142058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-71daca4a-d248-46d5-999f-7631ae96030a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.155557 Aug 04 13:57:53.142646 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 105/208] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:52 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:53.297459 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:53.298063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:53.304377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:53.304840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:53.305594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:53.306017 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:53.316485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d83cddbe-3acd-4202-b062-acecdefd5fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:53.317101 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d83cddbe-3acd-4202-b062-acecdefd5fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:53.324949 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d83cddbe-3acd-4202-b062-acecdefd5fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:53.325507 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d83cddbe-3acd-4202-b062-acecdefd5fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:53.326800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d83cddbe-3acd-4202-b062-acecdefd5fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:53.326800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d83cddbe-3acd-4202-b062-acecdefd5fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:53.477442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d83cddbe-3acd-4202-b062-acecdefd5fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:53.484688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:53.492196 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d83cddbe-3acd-4202-b062-acecdefd5fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.176142 Aug 04 13:57:53.492196 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 106/209] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:53 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:53.493717 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:53.495321 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:53.496547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4a703213-dbd9-4ff4-a5b0-638c61bf2094 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.203402 Aug 04 13:57:53.497208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 104/210] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:53 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:53.872675 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e25092a6-28a2-4983-a2bb-791c48f37dda tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:53.873357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e25092a6-28a2-4983-a2bb-791c48f37dda tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:53.880831 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e25092a6-28a2-4983-a2bb-791c48f37dda tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:53.881382 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e25092a6-28a2-4983-a2bb-791c48f37dda tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:53.882260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e25092a6-28a2-4983-a2bb-791c48f37dda tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:53.882801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e25092a6-28a2-4983-a2bb-791c48f37dda tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.030383 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e25092a6-28a2-4983-a2bb-791c48f37dda tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:54.038845 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e25092a6-28a2-4983-a2bb-791c48f37dda tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.170379 Aug 04 13:57:54.039438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 107/211] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:53 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:54.083430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c0005106-eb1f-4432-b7ae-c3e7a33fdd69 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:54.084509 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c0005106-eb1f-4432-b7ae-c3e7a33fdd69 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:54.090927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0005106-eb1f-4432-b7ae-c3e7a33fdd69 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:54.091372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0005106-eb1f-4432-b7ae-c3e7a33fdd69 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.092157 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0005106-eb1f-4432-b7ae-c3e7a33fdd69 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:54.092617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0005106-eb1f-4432-b7ae-c3e7a33fdd69 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.160109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0f96f499-808e-4c2d-9f49-c06c0f783fcb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:54.160712 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0f96f499-808e-4c2d-9f49-c06c0f783fcb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:54.167467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0f96f499-808e-4c2d-9f49-c06c0f783fcb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:54.167910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0f96f499-808e-4c2d-9f49-c06c0f783fcb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.168734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0f96f499-808e-4c2d-9f49-c06c0f783fcb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:54.169167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0f96f499-808e-4c2d-9f49-c06c0f783fcb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.274885 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c0005106-eb1f-4432-b7ae-c3e7a33fdd69 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:54.282809 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c0005106-eb1f-4432-b7ae-c3e7a33fdd69 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.206475 Aug 04 13:57:54.283621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 105/212] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:54 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:54.331814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0f96f499-808e-4c2d-9f49-c06c0f783fcb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:54.341310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0f96f499-808e-4c2d-9f49-c06c0f783fcb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.185709 Aug 04 13:57:54.341906 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 108/213] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:54 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:54.505752 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7c74007b-de84-45e0-9bf2-0341eaa928fe tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:54.506356 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7c74007b-de84-45e0-9bf2-0341eaa928fe tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:54.514056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c74007b-de84-45e0-9bf2-0341eaa928fe tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:54.514632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c74007b-de84-45e0-9bf2-0341eaa928fe tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.516464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c74007b-de84-45e0-9bf2-0341eaa928fe tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:54.517154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c74007b-de84-45e0-9bf2-0341eaa928fe tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.519013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:54.520001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:54.528540 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:54.529238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.530456 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:54.532045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:54.694921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7c74007b-de84-45e0-9bf2-0341eaa928fe tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:54.697337 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:54.708268 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:54.709824 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:54.710969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e971fdfb-7b6e-4ba4-a5ac-87497671e03c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.199134 Aug 04 13:57:54.711535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 109/214] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:54 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:54.711677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7c74007b-de84-45e0-9bf2-0341eaa928fe tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.209421 Aug 04 13:57:54.712457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 106/215] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:54 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:55.057301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a532e135-b375-4350-b10e-6723bb63ea2a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:55.057996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a532e135-b375-4350-b10e-6723bb63ea2a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:55.065490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a532e135-b375-4350-b10e-6723bb63ea2a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.066061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a532e135-b375-4350-b10e-6723bb63ea2a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.067229 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a532e135-b375-4350-b10e-6723bb63ea2a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.067686 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a532e135-b375-4350-b10e-6723bb63ea2a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.221121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a532e135-b375-4350-b10e-6723bb63ea2a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:55.229641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a532e135-b375-4350-b10e-6723bb63ea2a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.176195 Aug 04 13:57:55.230228 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 110/216] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:55 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:55.301750 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8f42a3ab-6718-4696-a220-29d5f5069ef9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:55.302352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8f42a3ab-6718-4696-a220-29d5f5069ef9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:55.308793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f42a3ab-6718-4696-a220-29d5f5069ef9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.309232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f42a3ab-6718-4696-a220-29d5f5069ef9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.310014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f42a3ab-6718-4696-a220-29d5f5069ef9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.310480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f42a3ab-6718-4696-a220-29d5f5069ef9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.360873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-80f85363-5e75-49f1-a869-71a511322f01 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:55.361648 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-80f85363-5e75-49f1-a869-71a511322f01 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:55.369326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-80f85363-5e75-49f1-a869-71a511322f01 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.369772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-80f85363-5e75-49f1-a869-71a511322f01 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.370558 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-80f85363-5e75-49f1-a869-71a511322f01 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.370986 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-80f85363-5e75-49f1-a869-71a511322f01 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.538997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-80f85363-5e75-49f1-a869-71a511322f01 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:55.550011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-80f85363-5e75-49f1-a869-71a511322f01 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.194651 Aug 04 13:57:55.550626 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 111/217] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:55 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:55.665191 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8f42a3ab-6718-4696-a220-29d5f5069ef9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:55.674788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8f42a3ab-6718-4696-a220-29d5f5069ef9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.377983 Aug 04 13:57:55.675553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 107/218] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:55 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:55.732368 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:55.733080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:55.733835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c3153416-4b4a-43a1-b123-cc64bf5dc9f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:55.735315 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c3153416-4b4a-43a1-b123-cc64bf5dc9f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:55.741032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.741607 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.742464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.743023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.744145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c3153416-4b4a-43a1-b123-cc64bf5dc9f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.745319 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c3153416-4b4a-43a1-b123-cc64bf5dc9f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.758969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c3153416-4b4a-43a1-b123-cc64bf5dc9f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:55.761068 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c3153416-4b4a-43a1-b123-cc64bf5dc9f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:55.947179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:55.959094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:55.960756 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:55.961951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-459031da-11a6-4dbf-9cba-af4d0b023cec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.234094 Aug 04 13:57:55.962595 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 112/219] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:55 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:56.008570 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c3153416-4b4a-43a1-b123-cc64bf5dc9f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:56.023200 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c3153416-4b4a-43a1-b123-cc64bf5dc9f9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.289824 Aug 04 13:57:56.028481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 108/220] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:55 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:56.248846 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-07a84cd1-4a29-4981-8c6b-744969c7ba67 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:56.250732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-07a84cd1-4a29-4981-8c6b-744969c7ba67 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:56.258441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-07a84cd1-4a29-4981-8c6b-744969c7ba67 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:56.259151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-07a84cd1-4a29-4981-8c6b-744969c7ba67 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:56.260103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-07a84cd1-4a29-4981-8c6b-744969c7ba67 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:56.260771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-07a84cd1-4a29-4981-8c6b-744969c7ba67 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:56.427455 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-07a84cd1-4a29-4981-8c6b-744969c7ba67 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:56.435624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-07a84cd1-4a29-4981-8c6b-744969c7ba67 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.191834 Aug 04 13:57:56.436263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 113/221] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:56 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:56.573210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-860de913-82a1-43a7-983d-9e8c164e3944 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:56.574250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-860de913-82a1-43a7-983d-9e8c164e3944 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:56.585814 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-860de913-82a1-43a7-983d-9e8c164e3944 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:56.586583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-860de913-82a1-43a7-983d-9e8c164e3944 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:56.587955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-860de913-82a1-43a7-983d-9e8c164e3944 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:56.588760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-860de913-82a1-43a7-983d-9e8c164e3944 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:56.705622 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3afba010-8ffd-49ae-9754-c6992e2d1749 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:56.706640 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3afba010-8ffd-49ae-9754-c6992e2d1749 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:56.717068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3afba010-8ffd-49ae-9754-c6992e2d1749 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:56.717965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3afba010-8ffd-49ae-9754-c6992e2d1749 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:56.720378 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3afba010-8ffd-49ae-9754-c6992e2d1749 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:56.721285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3afba010-8ffd-49ae-9754-c6992e2d1749 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:56.797422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-860de913-82a1-43a7-983d-9e8c164e3944 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:56.806543 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-860de913-82a1-43a7-983d-9e8c164e3944 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.240226 Aug 04 13:57:56.817413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 109/222] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:56 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:56.891150 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3afba010-8ffd-49ae-9754-c6992e2d1749 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:56.901996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3afba010-8ffd-49ae-9754-c6992e2d1749 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.203527 Aug 04 13:57:56.903097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 114/223] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:56 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:56.981063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:56.981659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:56.987871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:56.988334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:56.989102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:56.989523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:57.047509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2737e4bd-78cb-481b-b41f-35193d816022 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:57.048679 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2737e4bd-78cb-481b-b41f-35193d816022 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:57.063421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2737e4bd-78cb-481b-b41f-35193d816022 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:57.065570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2737e4bd-78cb-481b-b41f-35193d816022 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:57.067407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2737e4bd-78cb-481b-b41f-35193d816022 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:57.068098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2737e4bd-78cb-481b-b41f-35193d816022 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:57.185269 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:57.201643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:57.205493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:57.207635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4631dacf-daf0-433f-8d3a-fdaedff02252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.230003 Aug 04 13:57:57.208936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 110/224] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:56 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:57.283817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2737e4bd-78cb-481b-b41f-35193d816022 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:57.293991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2737e4bd-78cb-481b-b41f-35193d816022 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.253444 Aug 04 13:57:57.294947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 115/225] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:57 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:57.454472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b6c6614-bb0b-474d-b833-67b4d7fcef20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:57.455084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b6c6614-bb0b-474d-b833-67b4d7fcef20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:57.461578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b6c6614-bb0b-474d-b833-67b4d7fcef20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:57.462680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b6c6614-bb0b-474d-b833-67b4d7fcef20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:57.463476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b6c6614-bb0b-474d-b833-67b4d7fcef20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:57.463911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b6c6614-bb0b-474d-b833-67b4d7fcef20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:57.600757 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1b6c6614-bb0b-474d-b833-67b4d7fcef20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:57.608433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b6c6614-bb0b-474d-b833-67b4d7fcef20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.158133 Aug 04 13:57:57.609051 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 111/226] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:57 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:57.825670 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d2b48dd9-2325-4b6a-8d3f-67d94d2847b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:57.826645 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d2b48dd9-2325-4b6a-8d3f-67d94d2847b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:57.832925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2b48dd9-2325-4b6a-8d3f-67d94d2847b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:57.833374 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2b48dd9-2325-4b6a-8d3f-67d94d2847b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:57.834400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2b48dd9-2325-4b6a-8d3f-67d94d2847b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:57.834812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2b48dd9-2325-4b6a-8d3f-67d94d2847b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:57.928816 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f9129cae-8273-4fe2-9cd2-984fc945832d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:57.929823 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f9129cae-8273-4fe2-9cd2-984fc945832d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:57.938561 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f9129cae-8273-4fe2-9cd2-984fc945832d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:57.939778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f9129cae-8273-4fe2-9cd2-984fc945832d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:57.940105 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f9129cae-8273-4fe2-9cd2-984fc945832d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:57.940652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f9129cae-8273-4fe2-9cd2-984fc945832d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:58.003259 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d2b48dd9-2325-4b6a-8d3f-67d94d2847b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:58.013188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d2b48dd9-2325-4b6a-8d3f-67d94d2847b3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.191112 Aug 04 13:57:58.016566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 116/227] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:57 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:58.143557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f9129cae-8273-4fe2-9cd2-984fc945832d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:58.153176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f9129cae-8273-4fe2-9cd2-984fc945832d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.229142 Aug 04 13:57:58.153946 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 112/228] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:57 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:58.176986 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-93789706-b488-4792-babe-540bac1073bf req-c5427df0-4fdc-49da-aaa5-d2eee0aaeb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee769da-062a-4fe8-bd70-3dce1f031665", "name": "network-vif-plugged", "status": "completed", "tag": "cca51760-a38b-4efa-be59-cfcd9a84171a"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:58.180492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:58.180492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:57:58.194984 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-93789706-b488-4792-babe-540bac1073bf req-c5427df0-4fdc-49da-aaa5-d2eee0aaeb7b service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:58.195760 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-93789706-b488-4792-babe-540bac1073bf req-c5427df0-4fdc-49da-aaa5-d2eee0aaeb7b service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:58.215006 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-93789706-b488-4792-babe-540bac1073bf req-c5427df0-4fdc-49da-aaa5-d2eee0aaeb7b service nova] Creating event network-vif-plugged:cca51760-a38b-4efa-be59-cfcd9a84171a for instance 7ee769da-062a-4fe8-bd70-3dce1f031665 on hv-cinder-79264 Aug 04 13:57:58.220883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-93789706-b488-4792-babe-540bac1073bf req-c5427df0-4fdc-49da-aaa5-d2eee0aaeb7b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052838 Aug 04 13:57:58.221495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 117/229] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:57:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:58.232194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:58.233558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:58.254127 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:58.254668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:58.255865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:58.256491 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:58.317602 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e6484c1c-ea8f-4ef7-b65e-54203056e298 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:58.318984 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e6484c1c-ea8f-4ef7-b65e-54203056e298 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:58.332779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6484c1c-ea8f-4ef7-b65e-54203056e298 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:58.332779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6484c1c-ea8f-4ef7-b65e-54203056e298 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:58.335093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6484c1c-ea8f-4ef7-b65e-54203056e298 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:58.335442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6484c1c-ea8f-4ef7-b65e-54203056e298 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:58.483600 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:58.497379 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:58.499066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:58.501160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-aaa49582-0a4c-462a-8b97-fc4e7f4636da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.278023 Aug 04 13:57:58.501777 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 113/230] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:58 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:58.570961 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e6484c1c-ea8f-4ef7-b65e-54203056e298 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:58.579700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e6484c1c-ea8f-4ef7-b65e-54203056e298 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.269487 Aug 04 13:57:58.580339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 118/231] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:58 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:58.629721 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2ceaa863-1716-441b-8d42-9bbcf3b2b6be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:58.630738 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2ceaa863-1716-441b-8d42-9bbcf3b2b6be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:58.642236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ceaa863-1716-441b-8d42-9bbcf3b2b6be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:58.643080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ceaa863-1716-441b-8d42-9bbcf3b2b6be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:58.644632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ceaa863-1716-441b-8d42-9bbcf3b2b6be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:58.645410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ceaa863-1716-441b-8d42-9bbcf3b2b6be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:58.809917 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2ceaa863-1716-441b-8d42-9bbcf3b2b6be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:58.823288 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2ceaa863-1716-441b-8d42-9bbcf3b2b6be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.200670 Aug 04 13:57:58.824589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 114/232] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:58 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:59.038214 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8e5d668f-fe9c-4edd-b15c-079acb0de9ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.038755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8e5d668f-fe9c-4edd-b15c-079acb0de9ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:59.045116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e5d668f-fe9c-4edd-b15c-079acb0de9ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.045562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e5d668f-fe9c-4edd-b15c-079acb0de9ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.046405 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e5d668f-fe9c-4edd-b15c-079acb0de9ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.047074 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e5d668f-fe9c-4edd-b15c-079acb0de9ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.173856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4f810d62-d930-439c-9049-9b80aa921c0d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.174493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4f810d62-d930-439c-9049-9b80aa921c0d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:59.180902 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f810d62-d930-439c-9049-9b80aa921c0d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.181339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f810d62-d930-439c-9049-9b80aa921c0d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.182121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f810d62-d930-439c-9049-9b80aa921c0d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.182547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f810d62-d930-439c-9049-9b80aa921c0d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.188868 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8e5d668f-fe9c-4edd-b15c-079acb0de9ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:59.198842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8e5d668f-fe9c-4edd-b15c-079acb0de9ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.164277 Aug 04 13:57:59.199876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 119/233] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:59 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:59.335560 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4f810d62-d930-439c-9049-9b80aa921c0d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:59.348416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4f810d62-d930-439c-9049-9b80aa921c0d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.178329 Aug 04 13:57:59.349396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 115/234] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:59 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:59.530363 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.531061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:59.537312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.537779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.538557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.538982 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.597462 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-df377cac-428d-4695-a8ee-f7ebd0dd13a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.598083 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-df377cac-428d-4695-a8ee-f7ebd0dd13a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:59.604347 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-df377cac-428d-4695-a8ee-f7ebd0dd13a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.604804 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-df377cac-428d-4695-a8ee-f7ebd0dd13a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.605590 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-df377cac-428d-4695-a8ee-f7ebd0dd13a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.606023 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-df377cac-428d-4695-a8ee-f7ebd0dd13a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.697451 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:59.705981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:59.707483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:59.708615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-90926f7e-4dfc-4590-9ef6-0139438fef47 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.182099 Aug 04 13:57:59.709247 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 120/235] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:57:59 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:57:59.772868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-df377cac-428d-4695-a8ee-f7ebd0dd13a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:59.781668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-df377cac-428d-4695-a8ee-f7ebd0dd13a7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.187351 Aug 04 13:57:59.782264 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 116/236] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:59 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:59.842914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-06992131-1a95-4b25-b906-0c5feac690a5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.843970 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-06992131-1a95-4b25-b906-0c5feac690a5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:57:59.850151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-06992131-1a95-4b25-b906-0c5feac690a5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.850620 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-06992131-1a95-4b25-b906-0c5feac690a5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.851479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-06992131-1a95-4b25-b906-0c5feac690a5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:57:59.851907 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-06992131-1a95-4b25-b906-0c5feac690a5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:57:59.984639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-06992131-1a95-4b25-b906-0c5feac690a5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:59.993271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-06992131-1a95-4b25-b906-0c5feac690a5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.154133 Aug 04 13:57:59.993854 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 121/237] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:57:59 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:00.221225 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7dac6f73-c5ca-423e-90d1-cf6fe0275471 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:00.221835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7dac6f73-c5ca-423e-90d1-cf6fe0275471 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:00.227878 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7dac6f73-c5ca-423e-90d1-cf6fe0275471 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:00.228354 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7dac6f73-c5ca-423e-90d1-cf6fe0275471 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:00.229129 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7dac6f73-c5ca-423e-90d1-cf6fe0275471 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:00.229559 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7dac6f73-c5ca-423e-90d1-cf6fe0275471 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:00.359901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7dac6f73-c5ca-423e-90d1-cf6fe0275471 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:00.367571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7dac6f73-c5ca-423e-90d1-cf6fe0275471 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.150746 Aug 04 13:58:00.369569 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 117/238] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:00 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:00.371353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b09f4aca-cdfe-4dbd-926e-e2f2a2d324eb tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:00.372042 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b09f4aca-cdfe-4dbd-926e-e2f2a2d324eb tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:00.379428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b09f4aca-cdfe-4dbd-926e-e2f2a2d324eb tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:00.379698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b09f4aca-cdfe-4dbd-926e-e2f2a2d324eb tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:00.380505 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b09f4aca-cdfe-4dbd-926e-e2f2a2d324eb tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:00.380934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b09f4aca-cdfe-4dbd-926e-e2f2a2d324eb tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:00.542625 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b09f4aca-cdfe-4dbd-926e-e2f2a2d324eb tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:00.550688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b09f4aca-cdfe-4dbd-926e-e2f2a2d324eb tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.183072 Aug 04 13:58:00.550917 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 122/239] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:00 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:00.726687 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:00.727283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:00.733382 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:00.733826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:00.735596 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:00.735966 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:00.799028 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-61547478-40cc-4cc7-9b7c-792d28943243 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:00.799899 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-61547478-40cc-4cc7-9b7c-792d28943243 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:00.806410 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-61547478-40cc-4cc7-9b7c-792d28943243 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:00.806862 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-61547478-40cc-4cc7-9b7c-792d28943243 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:00.807641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-61547478-40cc-4cc7-9b7c-792d28943243 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:00.808078 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-61547478-40cc-4cc7-9b7c-792d28943243 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:00.873472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:00.882112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:00.883628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:00.884770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-28b38624-ef42-4aed-bc8b-482a22efc6cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.161836 Aug 04 13:58:00.885333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 118/240] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:00 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:00.943624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-61547478-40cc-4cc7-9b7c-792d28943243 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:00.951535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-61547478-40cc-4cc7-9b7c-792d28943243 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.156945 Aug 04 13:58:00.952111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 123/241] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:00 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:01.010047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ecb219c7-4f30-40b9-8dc9-f006229e084e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:01.010567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ecb219c7-4f30-40b9-8dc9-f006229e084e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:01.017052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ecb219c7-4f30-40b9-8dc9-f006229e084e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.017495 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ecb219c7-4f30-40b9-8dc9-f006229e084e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.018263 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ecb219c7-4f30-40b9-8dc9-f006229e084e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.018688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ecb219c7-4f30-40b9-8dc9-f006229e084e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.152002 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ecb219c7-4f30-40b9-8dc9-f006229e084e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:01.160089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ecb219c7-4f30-40b9-8dc9-f006229e084e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.153657 Aug 04 13:58:01.160725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 119/242] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:01 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:01.385261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-de8b66e6-8831-4014-93e2-051281aebf59 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:01.385867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-de8b66e6-8831-4014-93e2-051281aebf59 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:01.393133 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-de8b66e6-8831-4014-93e2-051281aebf59 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.393669 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-de8b66e6-8831-4014-93e2-051281aebf59 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.394658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-de8b66e6-8831-4014-93e2-051281aebf59 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.395101 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-de8b66e6-8831-4014-93e2-051281aebf59 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.567804 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-73e32840-0ac5-42a7-bbea-b6ee44170f33 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:01.568617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-73e32840-0ac5-42a7-bbea-b6ee44170f33 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:01.582282 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-73e32840-0ac5-42a7-bbea-b6ee44170f33 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.583150 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-73e32840-0ac5-42a7-bbea-b6ee44170f33 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.586807 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-de8b66e6-8831-4014-93e2-051281aebf59 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:01.589525 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-73e32840-0ac5-42a7-bbea-b6ee44170f33 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.590495 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-73e32840-0ac5-42a7-bbea-b6ee44170f33 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.596822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-de8b66e6-8831-4014-93e2-051281aebf59 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.215113 Aug 04 13:58:01.597634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 124/243] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:01 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:01.753576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-73e32840-0ac5-42a7-bbea-b6ee44170f33 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:01.761780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-73e32840-0ac5-42a7-bbea-b6ee44170f33 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.198506 Aug 04 13:58:01.762375 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 120/244] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:01 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:01.904336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:01.905280 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:01.912184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.912954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.913688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.914121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.969583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-60939c96-22ab-4dcc-a5b4-b88a5662fa65 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:01.970221 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-60939c96-22ab-4dcc-a5b4-b88a5662fa65 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:01.976535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-60939c96-22ab-4dcc-a5b4-b88a5662fa65 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.976980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-60939c96-22ab-4dcc-a5b4-b88a5662fa65 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:01.977770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-60939c96-22ab-4dcc-a5b4-b88a5662fa65 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:01.978198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-60939c96-22ab-4dcc-a5b4-b88a5662fa65 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:02.066131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:02.080789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:02.082637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:02.083891 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1e5206bf-3718-4d9a-9e24-696aacf55d2f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.184161 Aug 04 13:58:02.084578 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 125/245] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:01 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:02.123372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-60939c96-22ab-4dcc-a5b4-b88a5662fa65 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:02.131124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-60939c96-22ab-4dcc-a5b4-b88a5662fa65 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.165325 Aug 04 13:58:02.131713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 121/246] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:01 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:02.178041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-97cf7a62-ca67-4cc5-b9eb-68af065ae2ee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:02.178593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-97cf7a62-ca67-4cc5-b9eb-68af065ae2ee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:02.184869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-97cf7a62-ca67-4cc5-b9eb-68af065ae2ee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:02.185323 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-97cf7a62-ca67-4cc5-b9eb-68af065ae2ee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:02.186077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-97cf7a62-ca67-4cc5-b9eb-68af065ae2ee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:02.186498 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-97cf7a62-ca67-4cc5-b9eb-68af065ae2ee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:02.344535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-97cf7a62-ca67-4cc5-b9eb-68af065ae2ee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:02.355962 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-97cf7a62-ca67-4cc5-b9eb-68af065ae2ee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.181341 Aug 04 13:58:02.357107 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 126/247] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:02 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:02.621950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-11232476-103a-4e54-8746-f8cf1ff1edea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:02.622565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-11232476-103a-4e54-8746-f8cf1ff1edea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:02.628623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-11232476-103a-4e54-8746-f8cf1ff1edea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:02.629072 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-11232476-103a-4e54-8746-f8cf1ff1edea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:02.630132 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-11232476-103a-4e54-8746-f8cf1ff1edea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:02.630565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-11232476-103a-4e54-8746-f8cf1ff1edea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:02.768316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-11232476-103a-4e54-8746-f8cf1ff1edea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:02.776207 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-11232476-103a-4e54-8746-f8cf1ff1edea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.157820 Aug 04 13:58:02.776988 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 122/248] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:02 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:02.779194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ce9b7cc2-f177-47b8-8cde-899017dc37ce tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:02.779832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ce9b7cc2-f177-47b8-8cde-899017dc37ce tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:02.787139 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce9b7cc2-f177-47b8-8cde-899017dc37ce tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:02.787511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce9b7cc2-f177-47b8-8cde-899017dc37ce tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:02.788340 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce9b7cc2-f177-47b8-8cde-899017dc37ce tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:02.788770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce9b7cc2-f177-47b8-8cde-899017dc37ce tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:02.934705 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ce9b7cc2-f177-47b8-8cde-899017dc37ce tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:02.948311 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ce9b7cc2-f177-47b8-8cde-899017dc37ce tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.172567 Aug 04 13:58:02.949377 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 127/249] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:02 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:03.103894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:03.104584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:03.111848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.112317 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.113083 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.113511 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.154965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1b3c9ce6-6258-41b7-9cd6-5ff45ba54ee8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:03.155608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1b3c9ce6-6258-41b7-9cd6-5ff45ba54ee8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:03.162134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b3c9ce6-6258-41b7-9cd6-5ff45ba54ee8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.162571 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b3c9ce6-6258-41b7-9cd6-5ff45ba54ee8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.163371 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b3c9ce6-6258-41b7-9cd6-5ff45ba54ee8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.163806 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b3c9ce6-6258-41b7-9cd6-5ff45ba54ee8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.264094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:03.274805 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:03.276450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:03.277806 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d99f37ab-c06c-476e-acc9-550e64387c83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.177998 Aug 04 13:58:03.278380 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 123/250] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:03 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:03.317435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1b3c9ce6-6258-41b7-9cd6-5ff45ba54ee8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:03.325276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1b3c9ce6-6258-41b7-9cd6-5ff45ba54ee8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.174207 Aug 04 13:58:03.325871 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 128/251] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:03 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:03.375950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-231ac958-7a00-4f73-9284-14f9c08db46f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:03.376796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-231ac958-7a00-4f73-9284-14f9c08db46f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:03.383259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-231ac958-7a00-4f73-9284-14f9c08db46f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.383699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-231ac958-7a00-4f73-9284-14f9c08db46f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.384505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-231ac958-7a00-4f73-9284-14f9c08db46f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.384986 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-231ac958-7a00-4f73-9284-14f9c08db46f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.522921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-231ac958-7a00-4f73-9284-14f9c08db46f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:03.531927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-231ac958-7a00-4f73-9284-14f9c08db46f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.159950 Aug 04 13:58:03.532759 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 124/252] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:03 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:03.795623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e9919fa2-e9da-4d92-806d-007ae20bf6d1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:03.796296 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e9919fa2-e9da-4d92-806d-007ae20bf6d1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:03.802726 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9919fa2-e9da-4d92-806d-007ae20bf6d1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.803166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9919fa2-e9da-4d92-806d-007ae20bf6d1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.803935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9919fa2-e9da-4d92-806d-007ae20bf6d1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.804393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9919fa2-e9da-4d92-806d-007ae20bf6d1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.948123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e9919fa2-e9da-4d92-806d-007ae20bf6d1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:03.957322 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e9919fa2-e9da-4d92-806d-007ae20bf6d1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.165170 Aug 04 13:58:03.958168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 129/253] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:03 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:03.969978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9f9198a8-1d44-49b8-8b12-d58c069c3aad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:03.970749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9f9198a8-1d44-49b8-8b12-d58c069c3aad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:03.977055 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9f9198a8-1d44-49b8-8b12-d58c069c3aad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.977501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9f9198a8-1d44-49b8-8b12-d58c069c3aad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:03.978261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9f9198a8-1d44-49b8-8b12-d58c069c3aad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:03.978683 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9f9198a8-1d44-49b8-8b12-d58c069c3aad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:04.111041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9f9198a8-1d44-49b8-8b12-d58c069c3aad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:04.118568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9f9198a8-1d44-49b8-8b12-d58c069c3aad tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.154254 Aug 04 13:58:04.119159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 125/254] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:03 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:04.306529 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:04.307137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:04.315981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:04.316770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:04.318061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:04.318775 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:04.342363 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a67c65eb-0d58-4b8f-becf-25e8be875d85 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:04.342974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a67c65eb-0d58-4b8f-becf-25e8be875d85 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:04.350111 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a67c65eb-0d58-4b8f-becf-25e8be875d85 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:04.350553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a67c65eb-0d58-4b8f-becf-25e8be875d85 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:04.351329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a67c65eb-0d58-4b8f-becf-25e8be875d85 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:04.351755 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a67c65eb-0d58-4b8f-becf-25e8be875d85 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:04.481254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:04.494013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:04.495744 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:04.496919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-303255d6-4312-4473-9a8b-5a5444154ff7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.194173 Aug 04 13:58:04.497786 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 130/255] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:04 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:04.504809 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a67c65eb-0d58-4b8f-becf-25e8be875d85 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:04.512848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a67c65eb-0d58-4b8f-becf-25e8be875d85 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.174151 Aug 04 13:58:04.513432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 126/256] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:04 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:04.557337 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-05747109-c2ed-41e0-991a-7398e0710467 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:04.558037 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-05747109-c2ed-41e0-991a-7398e0710467 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:04.564990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05747109-c2ed-41e0-991a-7398e0710467 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:04.565428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05747109-c2ed-41e0-991a-7398e0710467 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:04.566195 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05747109-c2ed-41e0-991a-7398e0710467 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:04.566620 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05747109-c2ed-41e0-991a-7398e0710467 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:04.747852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-05747109-c2ed-41e0-991a-7398e0710467 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:04.757125 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-05747109-c2ed-41e0-991a-7398e0710467 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.203644 Aug 04 13:58:04.757814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 131/257] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:04 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:04.975238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-31967fa7-8671-4799-8c1a-e4cd55f5636f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:04.975839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-31967fa7-8671-4799-8c1a-e4cd55f5636f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:04.981976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31967fa7-8671-4799-8c1a-e4cd55f5636f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:04.982415 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31967fa7-8671-4799-8c1a-e4cd55f5636f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:04.983194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31967fa7-8671-4799-8c1a-e4cd55f5636f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:04.984147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31967fa7-8671-4799-8c1a-e4cd55f5636f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.127869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-31967fa7-8671-4799-8c1a-e4cd55f5636f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:05.135777 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-31967fa7-8671-4799-8c1a-e4cd55f5636f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.164187 Aug 04 13:58:05.136135 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2bd61c63-ab93-4dc4-8c97-52cbf7776c39 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:05.136845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 127/258] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:04 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:05.137047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2bd61c63-ab93-4dc4-8c97-52cbf7776c39 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:05.144706 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bd61c63-ab93-4dc4-8c97-52cbf7776c39 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:05.145146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bd61c63-ab93-4dc4-8c97-52cbf7776c39 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.145999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bd61c63-ab93-4dc4-8c97-52cbf7776c39 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:05.146428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bd61c63-ab93-4dc4-8c97-52cbf7776c39 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.279695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2bd61c63-ab93-4dc4-8c97-52cbf7776c39 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:05.287803 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2bd61c63-ab93-4dc4-8c97-52cbf7776c39 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.155327 Aug 04 13:58:05.288420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 132/259] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:05 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:05.517769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:05.518360 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:05.529896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:05.530338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.531116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:05.531548 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.531807 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e6f3ec39-53b3-44a6-ba59-c4a346124302 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:05.532448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e6f3ec39-53b3-44a6-ba59-c4a346124302 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:05.538753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6f3ec39-53b3-44a6-ba59-c4a346124302 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:05.539207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6f3ec39-53b3-44a6-ba59-c4a346124302 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.540058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6f3ec39-53b3-44a6-ba59-c4a346124302 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:05.540556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6f3ec39-53b3-44a6-ba59-c4a346124302 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.679729 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:05.689262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:05.690811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:05.691951 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9862f204-36ae-461f-8060-80261c74a036 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.178023 Aug 04 13:58:05.692576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 128/260] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:05 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:05.697348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e6f3ec39-53b3-44a6-ba59-c4a346124302 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:05.706382 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e6f3ec39-53b3-44a6-ba59-c4a346124302 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.178880 Aug 04 13:58:05.707299 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 133/261] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:05 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:05.775135 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3e93301c-b3b5-42f3-bff0-52941a2bb8fc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:05.775742 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3e93301c-b3b5-42f3-bff0-52941a2bb8fc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:05.782825 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3e93301c-b3b5-42f3-bff0-52941a2bb8fc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:05.783335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3e93301c-b3b5-42f3-bff0-52941a2bb8fc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.784066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3e93301c-b3b5-42f3-bff0-52941a2bb8fc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:05.784600 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3e93301c-b3b5-42f3-bff0-52941a2bb8fc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:05.943757 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3e93301c-b3b5-42f3-bff0-52941a2bb8fc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:05.952265 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3e93301c-b3b5-42f3-bff0-52941a2bb8fc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.180747 Aug 04 13:58:05.953523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 129/262] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:05 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:06.154266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-60c30d67-46e7-4c17-bb19-c6cb223fac54 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:06.155068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-60c30d67-46e7-4c17-bb19-c6cb223fac54 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:06.162312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-60c30d67-46e7-4c17-bb19-c6cb223fac54 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.162910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-60c30d67-46e7-4c17-bb19-c6cb223fac54 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.163788 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-60c30d67-46e7-4c17-bb19-c6cb223fac54 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.164363 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-60c30d67-46e7-4c17-bb19-c6cb223fac54 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.305521 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c2a90d95-8974-4071-9978-d7808a907489 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:06.306321 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c2a90d95-8974-4071-9978-d7808a907489 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:06.313459 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2a90d95-8974-4071-9978-d7808a907489 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.313914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2a90d95-8974-4071-9978-d7808a907489 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.314718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2a90d95-8974-4071-9978-d7808a907489 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.315171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2a90d95-8974-4071-9978-d7808a907489 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.321901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-60c30d67-46e7-4c17-bb19-c6cb223fac54 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:06.335421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-60c30d67-46e7-4c17-bb19-c6cb223fac54 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.184908 Aug 04 13:58:06.336541 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 134/263] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:06 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:06.474138 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c2a90d95-8974-4071-9978-d7808a907489 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:06.482122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c2a90d95-8974-4071-9978-d7808a907489 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.180493 Aug 04 13:58:06.482975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 130/264] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:06 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:06.715277 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:06.715879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:06.723738 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-adebe86d-80fb-4638-a19e-29958f759037 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:06.724097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.724502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.724789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-adebe86d-80fb-4638-a19e-29958f759037 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:06.725487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.725910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.736294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-adebe86d-80fb-4638-a19e-29958f759037 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.737091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-adebe86d-80fb-4638-a19e-29958f759037 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.738485 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-adebe86d-80fb-4638-a19e-29958f759037 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.739250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-adebe86d-80fb-4638-a19e-29958f759037 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.890304 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:06.898720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:06.900336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:06.901469 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1d051817-25f9-45f8-a45e-8940c7682cb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.190370 Aug 04 13:58:06.902058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 135/265] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:06 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:06.941319 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-adebe86d-80fb-4638-a19e-29958f759037 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:06.954556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-adebe86d-80fb-4638-a19e-29958f759037 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.234313 Aug 04 13:58:06.955623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 131/266] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:06 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:06.971526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5a222173-6b5c-4c32-8870-af0c16a43cac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:06.972534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5a222173-6b5c-4c32-8870-af0c16a43cac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:06.980424 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5a222173-6b5c-4c32-8870-af0c16a43cac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.980992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5a222173-6b5c-4c32-8870-af0c16a43cac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:06.982139 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5a222173-6b5c-4c32-8870-af0c16a43cac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:06.982765 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5a222173-6b5c-4c32-8870-af0c16a43cac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:07.140465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5a222173-6b5c-4c32-8870-af0c16a43cac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:07.148852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5a222173-6b5c-4c32-8870-af0c16a43cac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.181870 Aug 04 13:58:07.149429 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 136/267] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:06 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:07.354101 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cb3617e1-5015-4e82-9ca8-1716c99171c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:07.354643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cb3617e1-5015-4e82-9ca8-1716c99171c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:07.361492 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cb3617e1-5015-4e82-9ca8-1716c99171c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:07.361939 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cb3617e1-5015-4e82-9ca8-1716c99171c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:07.363209 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cb3617e1-5015-4e82-9ca8-1716c99171c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:07.363977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cb3617e1-5015-4e82-9ca8-1716c99171c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:07.502330 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-59adce26-c0fc-4b36-bb6d-947e2ef93d3c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:07.502982 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-59adce26-c0fc-4b36-bb6d-947e2ef93d3c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:07.511513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59adce26-c0fc-4b36-bb6d-947e2ef93d3c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:07.511966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59adce26-c0fc-4b36-bb6d-947e2ef93d3c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:07.512825 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59adce26-c0fc-4b36-bb6d-947e2ef93d3c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:07.513269 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59adce26-c0fc-4b36-bb6d-947e2ef93d3c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:07.524304 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cb3617e1-5015-4e82-9ca8-1716c99171c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:07.535980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cb3617e1-5015-4e82-9ca8-1716c99171c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.185575 Aug 04 13:58:07.537813 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 132/268] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:07 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:07.673873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-59adce26-c0fc-4b36-bb6d-947e2ef93d3c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:07.681427 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-59adce26-c0fc-4b36-bb6d-947e2ef93d3c tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.184918 Aug 04 13:58:07.682032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 137/269] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:07 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:07.929740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:07.930824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:07.942373 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:07.943161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:07.944531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:07.945416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:07.983503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d2ecb4af-7126-4a42-996d-d045c81cecad tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:07.987513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d2ecb4af-7126-4a42-996d-d045c81cecad tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:08.003315 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2ecb4af-7126-4a42-996d-d045c81cecad tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:08.006235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2ecb4af-7126-4a42-996d-d045c81cecad tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:08.016344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2ecb4af-7126-4a42-996d-d045c81cecad tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:08.017403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2ecb4af-7126-4a42-996d-d045c81cecad tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:08.183039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.191612 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.193160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.194308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7567cb25-99b9-46cd-86d4-a74a4269a31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.270634 Aug 04 13:58:08.194920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 133/270] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:07 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:08.199632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1f94ad0e-55a7-4c9b-9585-52a612c38bee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:08.200259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1f94ad0e-55a7-4c9b-9585-52a612c38bee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:08.206722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f94ad0e-55a7-4c9b-9585-52a612c38bee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:08.207162 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f94ad0e-55a7-4c9b-9585-52a612c38bee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:08.207937 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f94ad0e-55a7-4c9b-9585-52a612c38bee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:08.208407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f94ad0e-55a7-4c9b-9585-52a612c38bee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:08.271264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d2ecb4af-7126-4a42-996d-d045c81cecad tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.281169 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d2ecb4af-7126-4a42-996d-d045c81cecad tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.304585 Aug 04 13:58:08.281998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 138/271] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:07 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:08.365910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1f94ad0e-55a7-4c9b-9585-52a612c38bee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.375899 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1f94ad0e-55a7-4c9b-9585-52a612c38bee tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.178643 Aug 04 13:58:08.376552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 134/272] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:08 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:08.564418 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-648ad0a3-bb0d-4222-80dd-17eca03ae539 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:08.565097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-648ad0a3-bb0d-4222-80dd-17eca03ae539 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:08.571661 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-648ad0a3-bb0d-4222-80dd-17eca03ae539 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:08.572107 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-648ad0a3-bb0d-4222-80dd-17eca03ae539 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:08.572970 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-648ad0a3-bb0d-4222-80dd-17eca03ae539 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:08.573395 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-648ad0a3-bb0d-4222-80dd-17eca03ae539 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:08.699388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-82a223fb-4948-430d-bf2c-16109b6f585d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:08.700142 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-82a223fb-4948-430d-bf2c-16109b6f585d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:08.706603 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-82a223fb-4948-430d-bf2c-16109b6f585d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:08.707057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-82a223fb-4948-430d-bf2c-16109b6f585d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:08.707287 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-648ad0a3-bb0d-4222-80dd-17eca03ae539 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.707864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-82a223fb-4948-430d-bf2c-16109b6f585d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:08.708325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-82a223fb-4948-430d-bf2c-16109b6f585d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:08.716528 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-648ad0a3-bb0d-4222-80dd-17eca03ae539 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.156374 Aug 04 13:58:08.717155 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 139/273] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:08 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:08.841579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-82a223fb-4948-430d-bf2c-16109b6f585d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.850735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-82a223fb-4948-430d-bf2c-16109b6f585d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1315 microversion: 2.1 time: 0.155288 Aug 04 13:58:08.851455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 135/274] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:08 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:09.220257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.221017 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:09.229317 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.229777 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.230723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.231257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.302369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e1609a66-1e6e-4ce8-a8af-3150a3fa4d17 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.303310 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e1609a66-1e6e-4ce8-a8af-3150a3fa4d17 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:09.311304 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1609a66-1e6e-4ce8-a8af-3150a3fa4d17 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.314154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1609a66-1e6e-4ce8-a8af-3150a3fa4d17 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.315110 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1609a66-1e6e-4ce8-a8af-3150a3fa4d17 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.315555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1609a66-1e6e-4ce8-a8af-3150a3fa4d17 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.412510 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:09.430044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:09.433948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:09.436046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6d1735af-1c9a-44d4-b90c-05f940958c12 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.221267 Aug 04 13:58:09.437034 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 140/275] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:09 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:09.459047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e30acf90-0539-4347-82d3-df40ff070dd1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.460256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e30acf90-0539-4347-82d3-df40ff070dd1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:09.471685 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e30acf90-0539-4347-82d3-df40ff070dd1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.472521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e30acf90-0539-4347-82d3-df40ff070dd1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.473934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e30acf90-0539-4347-82d3-df40ff070dd1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.474634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e30acf90-0539-4347-82d3-df40ff070dd1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.479845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e1609a66-1e6e-4ce8-a8af-3150a3fa4d17 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:09.491693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e1609a66-1e6e-4ce8-a8af-3150a3fa4d17 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.195565 Aug 04 13:58:09.492476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 136/276] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:09 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:09.635151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e30acf90-0539-4347-82d3-df40ff070dd1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:09.643691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e30acf90-0539-4347-82d3-df40ff070dd1 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1317 microversion: 2.1 time: 0.193884 Aug 04 13:58:09.644556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 141/277] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:09 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:09.734792 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2d75d02f-1977-45b7-9ab7-dfcc70fb0b29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.735309 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2d75d02f-1977-45b7-9ab7-dfcc70fb0b29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:09.741641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2d75d02f-1977-45b7-9ab7-dfcc70fb0b29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.742089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2d75d02f-1977-45b7-9ab7-dfcc70fb0b29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.742909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2d75d02f-1977-45b7-9ab7-dfcc70fb0b29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.743438 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2d75d02f-1977-45b7-9ab7-dfcc70fb0b29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.871479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ca08926d-245a-482a-a8c9-cfd92e733ce2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.872332 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ca08926d-245a-482a-a8c9-cfd92e733ce2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:09.893948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca08926d-245a-482a-a8c9-cfd92e733ce2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.896509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca08926d-245a-482a-a8c9-cfd92e733ce2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.897357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca08926d-245a-482a-a8c9-cfd92e733ce2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:09.897792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca08926d-245a-482a-a8c9-cfd92e733ce2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:09.918609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2d75d02f-1977-45b7-9ab7-dfcc70fb0b29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:09.929837 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2d75d02f-1977-45b7-9ab7-dfcc70fb0b29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.198813 Aug 04 13:58:09.930432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 137/278] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:09 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:10.053718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ca08926d-245a-482a-a8c9-cfd92e733ce2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.062727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ca08926d-245a-482a-a8c9-cfd92e733ce2 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1502 microversion: 2.1 time: 0.194139 Aug 04 13:58:10.063549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 142/279] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:09 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:10.463025 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:10.463633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:10.470246 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.471789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:10.471789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.472046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:10.518441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4488a86b-3231-4fce-9945-0477fe0630c6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:10.519049 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4488a86b-3231-4fce-9945-0477fe0630c6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:10.527173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4488a86b-3231-4fce-9945-0477fe0630c6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.527772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4488a86b-3231-4fce-9945-0477fe0630c6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:10.528891 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4488a86b-3231-4fce-9945-0477fe0630c6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.529331 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4488a86b-3231-4fce-9945-0477fe0630c6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:10.669482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.685044 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.686573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.688878 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-86cf4388-b84e-41aa-b8b9-47c38887979e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.229752 Aug 04 13:58:10.689407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 138/280] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:10 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:10.703693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-c1d405f1-9b0c-4fc6-8a0d-f155f5155a6f req-a656f3aa-fba6-4370-aaf1-d1f6c86bce10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1349a3-e392-480b-84ed-d851137f5a0c", "name": "network-vif-plugged", "status": "completed", "tag": "c35367a7-2079-4165-ae77-a51b6092b849"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:10.705773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:10.705773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:58:10.714265 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-c1d405f1-9b0c-4fc6-8a0d-f155f5155a6f req-a656f3aa-fba6-4370-aaf1-d1f6c86bce10 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.715046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-c1d405f1-9b0c-4fc6-8a0d-f155f5155a6f req-a656f3aa-fba6-4370-aaf1-d1f6c86bce10 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:10.729101 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-c1d405f1-9b0c-4fc6-8a0d-f155f5155a6f req-a656f3aa-fba6-4370-aaf1-d1f6c86bce10 service nova] Creating event network-vif-plugged:c35367a7-2079-4165-ae77-a51b6092b849 for instance 2c1349a3-e392-480b-84ed-d851137f5a0c on hv-cinder-79264 Aug 04 13:58:10.736063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-c1d405f1-9b0c-4fc6-8a0d-f155f5155a6f req-a656f3aa-fba6-4370-aaf1-d1f6c86bce10 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038285 Aug 04 13:58:10.736710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 139/281] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:58:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:10.742038 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-62456764-3f1d-4be0-89d7-ca7bd378380c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:10.742839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-62456764-3f1d-4be0-89d7-ca7bd378380c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:10.751506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-62456764-3f1d-4be0-89d7-ca7bd378380c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.751974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-62456764-3f1d-4be0-89d7-ca7bd378380c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:10.752853 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-62456764-3f1d-4be0-89d7-ca7bd378380c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.753280 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-62456764-3f1d-4be0-89d7-ca7bd378380c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:10.919243 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4488a86b-3231-4fce-9945-0477fe0630c6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.920406 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-62456764-3f1d-4be0-89d7-ca7bd378380c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.927792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4488a86b-3231-4fce-9945-0477fe0630c6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.413962 Aug 04 13:58:10.929477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-62456764-3f1d-4be0-89d7-ca7bd378380c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1507 microversion: 2.1 time: 0.190783 Aug 04 13:58:10.929616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 143/282] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:10 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:10.930102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 140/283] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:10 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:10.948871 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-59d7fe39-100e-4334-a27c-59487ae01b6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:10.949671 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-59d7fe39-100e-4334-a27c-59487ae01b6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:10.956152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59d7fe39-100e-4334-a27c-59487ae01b6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.956836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59d7fe39-100e-4334-a27c-59487ae01b6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:10.958312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59d7fe39-100e-4334-a27c-59487ae01b6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:10.959516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59d7fe39-100e-4334-a27c-59487ae01b6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:11.112438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-59d7fe39-100e-4334-a27c-59487ae01b6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:11.121279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-59d7fe39-100e-4334-a27c-59487ae01b6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.176630 Aug 04 13:58:11.121772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 144/284] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:10 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:11.709036 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:11.709647 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:11.716501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:11.716976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:11.717759 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:11.718335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:11.853527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:11.862369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:11.863872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:11.864978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0c76863a-8dbc-4b02-aa1c-64651080b088 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.160369 Aug 04 13:58:11.865538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 141/285] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:11 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:11.945936 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-feaa7b53-df5b-48a2-bfed-74ec07183da1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:11.946820 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-feaa7b53-df5b-48a2-bfed-74ec07183da1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:11.953579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feaa7b53-df5b-48a2-bfed-74ec07183da1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:11.954131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feaa7b53-df5b-48a2-bfed-74ec07183da1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:11.954912 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feaa7b53-df5b-48a2-bfed-74ec07183da1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:11.955329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feaa7b53-df5b-48a2-bfed-74ec07183da1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:12.102516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-feaa7b53-df5b-48a2-bfed-74ec07183da1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:12.110556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-feaa7b53-df5b-48a2-bfed-74ec07183da1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.168020 Aug 04 13:58:12.111357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 145/286] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:11 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:12.139089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-180823aa-7a5e-4fe3-bc46-b2325f7bec2d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:12.139680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-180823aa-7a5e-4fe3-bc46-b2325f7bec2d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:12.146483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-180823aa-7a5e-4fe3-bc46-b2325f7bec2d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:12.146925 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-180823aa-7a5e-4fe3-bc46-b2325f7bec2d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:12.147699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-180823aa-7a5e-4fe3-bc46-b2325f7bec2d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:12.148357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-180823aa-7a5e-4fe3-bc46-b2325f7bec2d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:12.316473 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-180823aa-7a5e-4fe3-bc46-b2325f7bec2d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:12.324305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-180823aa-7a5e-4fe3-bc46-b2325f7bec2d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.188917 Aug 04 13:58:12.325193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 142/287] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:12 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:12.609591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b32fb9a5-8025-4a04-bea8-c853174127bf tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e37eb96-6cb2-4213-8a48-f48f2f90cb9c"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:12.610842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b32fb9a5-8025-4a04-bea8-c853174127bf tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:12.617560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b32fb9a5-8025-4a04-bea8-c853174127bf tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:12.618004 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b32fb9a5-8025-4a04-bea8-c853174127bf tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:12.618789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b32fb9a5-8025-4a04-bea8-c853174127bf tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:12.619212 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b32fb9a5-8025-4a04-bea8-c853174127bf tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:12.763055 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-46efdc55-9991-4c31-84b8-1fe38aecfe56 req-98d56d96-f9b8-491c-91d1-a236f03e3957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1daa517-619e-4605-8c20-906b075afd41", "name": "network-vif-plugged", "status": "completed", "tag": "0e6069d0-3962-435f-bbec-6c8cd1f4930d"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:12.765875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:12.765875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:58:12.776774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-46efdc55-9991-4c31-84b8-1fe38aecfe56 req-98d56d96-f9b8-491c-91d1-a236f03e3957 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:12.777417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-46efdc55-9991-4c31-84b8-1fe38aecfe56 req-98d56d96-f9b8-491c-91d1-a236f03e3957 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:12.791939 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-46efdc55-9991-4c31-84b8-1fe38aecfe56 req-98d56d96-f9b8-491c-91d1-a236f03e3957 service nova] Creating event network-vif-plugged:0e6069d0-3962-435f-bbec-6c8cd1f4930d for instance d1daa517-619e-4605-8c20-906b075afd41 on hv-cinder-79264 Aug 04 13:58:12.798179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-46efdc55-9991-4c31-84b8-1fe38aecfe56 req-98d56d96-f9b8-491c-91d1-a236f03e3957 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040297 Aug 04 13:58:12.798890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 143/288] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:58:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:12.883478 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:12.884188 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:12.891309 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:12.891748 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:12.892577 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:12.893000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:13.024106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:13.032838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:13.034329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:13.035403 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-043c8e4e-f29c-4ce4-b512-392f7491bd67 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.156001 Aug 04 13:58:13.035953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 144/289] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:12 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:13.133541 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a2973b88-f7e3-43c7-b09f-c829131a93aa tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:13.134044 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a2973b88-f7e3-43c7-b09f-c829131a93aa tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:13.140010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a2973b88-f7e3-43c7-b09f-c829131a93aa tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:13.140495 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a2973b88-f7e3-43c7-b09f-c829131a93aa tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:13.141843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a2973b88-f7e3-43c7-b09f-c829131a93aa tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:13.142333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a2973b88-f7e3-43c7-b09f-c829131a93aa tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:13.276340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a2973b88-f7e3-43c7-b09f-c829131a93aa tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:13.284136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a2973b88-f7e3-43c7-b09f-c829131a93aa tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.154250 Aug 04 13:58:13.284740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 145/290] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:13 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:13.342288 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-28f80ae3-15db-4d7e-96b3-3cc23d092003 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:13.342916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-28f80ae3-15db-4d7e-96b3-3cc23d092003 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:13.349328 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28f80ae3-15db-4d7e-96b3-3cc23d092003 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:13.349776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28f80ae3-15db-4d7e-96b3-3cc23d092003 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:13.350944 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28f80ae3-15db-4d7e-96b3-3cc23d092003 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:13.351384 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28f80ae3-15db-4d7e-96b3-3cc23d092003 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:13.536033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-28f80ae3-15db-4d7e-96b3-3cc23d092003 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:13.548388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-28f80ae3-15db-4d7e-96b3-3cc23d092003 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.209241 Aug 04 13:58:13.549218 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 146/291] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:13 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:14.054352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:14.055163 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:14.063457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:14.063900 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:14.064818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:14.065479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:14.214524 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:14.223023 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:14.224567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:14.225705 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d0f87358-71c8-427c-b6ce-cb4a1bf0f7a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.175389 Aug 04 13:58:14.226254 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 147/292] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:14 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:14.301052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c8823ebe-d2b1-4b31-922b-be76d7441086 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:14.301658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c8823ebe-d2b1-4b31-922b-be76d7441086 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:14.307710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c8823ebe-d2b1-4b31-922b-be76d7441086 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:14.308082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c8823ebe-d2b1-4b31-922b-be76d7441086 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:14.308892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c8823ebe-d2b1-4b31-922b-be76d7441086 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:14.309323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c8823ebe-d2b1-4b31-922b-be76d7441086 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:14.454644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c8823ebe-d2b1-4b31-922b-be76d7441086 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:14.463288 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c8823ebe-d2b1-4b31-922b-be76d7441086 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.165797 Aug 04 13:58:14.473309 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 148/293] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:14 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:14.573770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e48b44c7-a9b1-4dc9-b10b-760b29b45da9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:14.574314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e48b44c7-a9b1-4dc9-b10b-760b29b45da9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:14.582080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e48b44c7-a9b1-4dc9-b10b-760b29b45da9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:14.582527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e48b44c7-a9b1-4dc9-b10b-760b29b45da9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:14.583466 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e48b44c7-a9b1-4dc9-b10b-760b29b45da9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:14.583939 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e48b44c7-a9b1-4dc9-b10b-760b29b45da9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:14.717135 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e48b44c7-a9b1-4dc9-b10b-760b29b45da9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:14.724550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e48b44c7-a9b1-4dc9-b10b-760b29b45da9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.154798 Aug 04 13:58:14.725126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 149/294] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:14 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:14.813947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-17a10035-bbf5-464c-817e-9ada6474b22d req-e3af3071-6b14-43f0-9d31-9f3ef3589c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a6e241-9234-4ca1-b4ca-7b90733ab705", "name": "network-vif-plugged", "status": "completed", "tag": "828cc1c2-4556-4cd2-a0e7-2ed9383548e4"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:14.815571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:14.815571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:58:14.823028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-17a10035-bbf5-464c-817e-9ada6474b22d req-e3af3071-6b14-43f0-9d31-9f3ef3589c3e service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:14.823536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-17a10035-bbf5-464c-817e-9ada6474b22d req-e3af3071-6b14-43f0-9d31-9f3ef3589c3e service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:14.834643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-17a10035-bbf5-464c-817e-9ada6474b22d req-e3af3071-6b14-43f0-9d31-9f3ef3589c3e service nova] Creating event network-vif-plugged:828cc1c2-4556-4cd2-a0e7-2ed9383548e4 for instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 on hv-cinder-79264 Aug 04 13:58:14.839503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-17a10035-bbf5-464c-817e-9ada6474b22d req-e3af3071-6b14-43f0-9d31-9f3ef3589c3e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030079 Aug 04 13:58:14.840088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 150/295] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:58:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:15.244531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:15.245204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:15.252029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:15.252501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:15.253291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:15.253800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:15.395936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:15.404102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:15.406430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:15.408139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-eed96b07-bd2e-417f-bb43-79b59c681ba6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.167507 Aug 04 13:58:15.408747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 151/296] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:15 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:15.482536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-24d4f3a3-3f72-4d0e-99d5-4d0fddce19e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:15.483175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-24d4f3a3-3f72-4d0e-99d5-4d0fddce19e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:15.490186 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-24d4f3a3-3f72-4d0e-99d5-4d0fddce19e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:15.490621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-24d4f3a3-3f72-4d0e-99d5-4d0fddce19e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:15.491381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-24d4f3a3-3f72-4d0e-99d5-4d0fddce19e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:15.491800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-24d4f3a3-3f72-4d0e-99d5-4d0fddce19e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:15.630917 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-24d4f3a3-3f72-4d0e-99d5-4d0fddce19e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:15.642901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-24d4f3a3-3f72-4d0e-99d5-4d0fddce19e7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.165268 Aug 04 13:58:15.643538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 152/297] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:15 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:15.741579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b6f4b08-e9c1-46b8-89e7-ec280b6ff412 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:15.742537 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b6f4b08-e9c1-46b8-89e7-ec280b6ff412 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:15.749178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b08-e9c1-46b8-89e7-ec280b6ff412 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:15.749635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b08-e9c1-46b8-89e7-ec280b6ff412 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:15.750591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b08-e9c1-46b8-89e7-ec280b6ff412 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:15.751027 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b08-e9c1-46b8-89e7-ec280b6ff412 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:15.887851 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1b6f4b08-e9c1-46b8-89e7-ec280b6ff412 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:15.895743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b6f4b08-e9c1-46b8-89e7-ec280b6ff412 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.158224 Aug 04 13:58:15.896339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 153/298] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:15 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:16.429148 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:16.429148 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:16.435295 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:16.435746 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:16.436835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:16.437408 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:16.578909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:16.587618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:16.589204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:16.590281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6f823036-4093-4bb7-a078-82821c3bb2b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.168223 Aug 04 13:58:16.590839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 154/299] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:16 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:16.660768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-58645ea2-272a-412c-ae3c-f70a762dea64 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:16.661377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-58645ea2-272a-412c-ae3c-f70a762dea64 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:16.667578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58645ea2-272a-412c-ae3c-f70a762dea64 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:16.668070 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58645ea2-272a-412c-ae3c-f70a762dea64 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:16.668881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58645ea2-272a-412c-ae3c-f70a762dea64 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:16.669307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58645ea2-272a-412c-ae3c-f70a762dea64 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:16.810234 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-58645ea2-272a-412c-ae3c-f70a762dea64 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:16.820616 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-58645ea2-272a-412c-ae3c-f70a762dea64 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.163365 Aug 04 13:58:16.821450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 155/300] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:16 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:16.912525 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7e4a445f-d07b-48d2-9daa-14da6a6a1113 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:16.913040 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7e4a445f-d07b-48d2-9daa-14da6a6a1113 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:16.919128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e4a445f-d07b-48d2-9daa-14da6a6a1113 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:16.919571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e4a445f-d07b-48d2-9daa-14da6a6a1113 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:16.920361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e4a445f-d07b-48d2-9daa-14da6a6a1113 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:16.920792 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e4a445f-d07b-48d2-9daa-14da6a6a1113 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:17.049296 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7e4a445f-d07b-48d2-9daa-14da6a6a1113 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:17.056574 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7e4a445f-d07b-48d2-9daa-14da6a6a1113 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.147844 Aug 04 13:58:17.057136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 156/301] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:16 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:17.609108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:17.609777 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:17.615589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:17.616024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:17.616824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:17.617248 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:17.762653 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:17.772593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:17.774104 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:17.775184 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0ad4dab2-6d8e-43fe-a95e-177832beff84 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.169866 Aug 04 13:58:17.775756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 157/302] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:17 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:17.838440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cc4f001c-0182-4e11-9451-17f04db11f83 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:17.839075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cc4f001c-0182-4e11-9451-17f04db11f83 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:17.845954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cc4f001c-0182-4e11-9451-17f04db11f83 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:17.846397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cc4f001c-0182-4e11-9451-17f04db11f83 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:17.847177 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cc4f001c-0182-4e11-9451-17f04db11f83 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:17.847609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cc4f001c-0182-4e11-9451-17f04db11f83 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:18.004261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cc4f001c-0182-4e11-9451-17f04db11f83 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:18.014172 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cc4f001c-0182-4e11-9451-17f04db11f83 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.179316 Aug 04 13:58:18.015308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 158/303] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:17 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:18.074883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fcf65605-b1bf-4b3b-92f3-b1902394f0f6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:18.075496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fcf65605-b1bf-4b3b-92f3-b1902394f0f6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:18.083076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcf65605-b1bf-4b3b-92f3-b1902394f0f6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:18.083482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcf65605-b1bf-4b3b-92f3-b1902394f0f6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:18.084274 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcf65605-b1bf-4b3b-92f3-b1902394f0f6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:18.084702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcf65605-b1bf-4b3b-92f3-b1902394f0f6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:18.234528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fcf65605-b1bf-4b3b-92f3-b1902394f0f6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:18.241925 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fcf65605-b1bf-4b3b-92f3-b1902394f0f6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.170972 Aug 04 13:58:18.242489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 159/304] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:18 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:18.795993 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:18.797123 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:18.807487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:18.808424 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:18.809864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:18.810698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:18.971302 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:18.979579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:18.981101 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:18.982195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6fea3a4f-cd09-4ee9-92d4-ace7fd59b096 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.191151 Aug 04 13:58:18.982748 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 160/305] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:18 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:19.032192 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7608532c-8a74-4bbe-adfd-b3a1ec55d29a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:19.032826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7608532c-8a74-4bbe-adfd-b3a1ec55d29a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:19.039063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7608532c-8a74-4bbe-adfd-b3a1ec55d29a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:19.039438 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7608532c-8a74-4bbe-adfd-b3a1ec55d29a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:19.040240 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7608532c-8a74-4bbe-adfd-b3a1ec55d29a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:19.040673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7608532c-8a74-4bbe-adfd-b3a1ec55d29a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:19.175878 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7608532c-8a74-4bbe-adfd-b3a1ec55d29a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:19.183598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7608532c-8a74-4bbe-adfd-b3a1ec55d29a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.155604 Aug 04 13:58:19.184193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 161/306] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:19 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:19.261462 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-61c8e032-b508-41d8-b9a7-b3ed51be621d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:19.262463 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-61c8e032-b508-41d8-b9a7-b3ed51be621d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:19.269858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-61c8e032-b508-41d8-b9a7-b3ed51be621d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:19.270418 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-61c8e032-b508-41d8-b9a7-b3ed51be621d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:19.271291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-61c8e032-b508-41d8-b9a7-b3ed51be621d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:19.271934 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-61c8e032-b508-41d8-b9a7-b3ed51be621d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:19.410254 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-61c8e032-b508-41d8-b9a7-b3ed51be621d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:19.417670 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-61c8e032-b508-41d8-b9a7-b3ed51be621d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.162001 Aug 04 13:58:19.418236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 162/307] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:19 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:20.004416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:20.006091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:20.012760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:20.013292 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:20.014024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:20.014722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:20.026138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b32fb9a5-8025-4a04-bea8-c853174127bf tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "POST /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.420892 Aug 04 13:58:20.027028 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 146/308] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 13:58:12 2021] POST /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2/os-volume_attachments => generated 194 bytes in 7423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:20.166056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:20.175242 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:20.176855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:20.178057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-dbba8ca0-ff5f-4ac7-9251-6a1ef858aca4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.179996 Aug 04 13:58:20.178767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 163/309] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:19 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:20.201838 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3c39ec03-d18d-4713-8156-0f7ca6089fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:20.202724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3c39ec03-d18d-4713-8156-0f7ca6089fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:20.209086 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c39ec03-d18d-4713-8156-0f7ca6089fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:20.209517 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c39ec03-d18d-4713-8156-0f7ca6089fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:20.210420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c39ec03-d18d-4713-8156-0f7ca6089fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:20.210917 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c39ec03-d18d-4713-8156-0f7ca6089fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:20.345276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3c39ec03-d18d-4713-8156-0f7ca6089fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:20.353433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3c39ec03-d18d-4713-8156-0f7ca6089fd0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.155597 Aug 04 13:58:20.354023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 147/310] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:20 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:20.437931 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-993ae250-8710-4e98-9e26-c53f637eebfd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:20.438535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-993ae250-8710-4e98-9e26-c53f637eebfd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:20.445325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-993ae250-8710-4e98-9e26-c53f637eebfd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:20.445765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-993ae250-8710-4e98-9e26-c53f637eebfd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:20.446808 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-993ae250-8710-4e98-9e26-c53f637eebfd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:20.447223 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-993ae250-8710-4e98-9e26-c53f637eebfd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:20.598420 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-993ae250-8710-4e98-9e26-c53f637eebfd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:20.607440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-993ae250-8710-4e98-9e26-c53f637eebfd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1364 microversion: 2.1 time: 0.174171 Aug 04 13:58:20.609090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 164/311] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:20 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:21.197730 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:21.198369 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:21.204796 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:21.205235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:21.206003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:21.206418 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:21.349692 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:21.357984 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:21.360172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:21.361372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b5b3b68e-a325-4d44-8575-73126e4ec4fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.167778 Aug 04 13:58:21.361955 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 148/312] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:21 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:21.377333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5714969d-4b5a-476b-a4ac-f444540352a3 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:21.378390 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5714969d-4b5a-476b-a4ac-f444540352a3 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:21.386562 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5714969d-4b5a-476b-a4ac-f444540352a3 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:21.387010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5714969d-4b5a-476b-a4ac-f444540352a3 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:21.387785 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5714969d-4b5a-476b-a4ac-f444540352a3 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:21.388233 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5714969d-4b5a-476b-a4ac-f444540352a3 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:21.544368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5714969d-4b5a-476b-a4ac-f444540352a3 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:21.554179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5714969d-4b5a-476b-a4ac-f444540352a3 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.183744 Aug 04 13:58:21.554875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 165/313] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:21 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:21.634665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a73eb9f7-e9f6-4f97-a023-cc50d4caa85d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:21.635566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a73eb9f7-e9f6-4f97-a023-cc50d4caa85d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:21.644515 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a73eb9f7-e9f6-4f97-a023-cc50d4caa85d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:21.644966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a73eb9f7-e9f6-4f97-a023-cc50d4caa85d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:21.645776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a73eb9f7-e9f6-4f97-a023-cc50d4caa85d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:21.646205 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a73eb9f7-e9f6-4f97-a023-cc50d4caa85d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:21.852865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a73eb9f7-e9f6-4f97-a023-cc50d4caa85d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:21.866403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a73eb9f7-e9f6-4f97-a023-cc50d4caa85d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1551 microversion: 2.1 time: 0.236167 Aug 04 13:58:21.867188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 149/314] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:21 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1551 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:21.893195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-366e4b84-ef6a-40f7-978a-0806a2d8120e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:21.893894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-366e4b84-ef6a-40f7-978a-0806a2d8120e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:21.900807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-366e4b84-ef6a-40f7-978a-0806a2d8120e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:21.901277 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-366e4b84-ef6a-40f7-978a-0806a2d8120e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:21.902083 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-366e4b84-ef6a-40f7-978a-0806a2d8120e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:21.902867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-366e4b84-ef6a-40f7-978a-0806a2d8120e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:22.049385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-366e4b84-ef6a-40f7-978a-0806a2d8120e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161533 Aug 04 13:58:22.050105 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 166/315] 10.222.0.43 () {58 vars in 1275 bytes} [Wed Aug 4 13:58:21 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:22.083340 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d9cf04d5-8f90-448a-942e-61bfd6a95fa0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83a034d9-b9c7-4afa-8194-37bea08bcf3d"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:22.085657 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d9cf04d5-8f90-448a-942e-61bfd6a95fa0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:22.099083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d9cf04d5-8f90-448a-942e-61bfd6a95fa0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:22.099934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d9cf04d5-8f90-448a-942e-61bfd6a95fa0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:22.100761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d9cf04d5-8f90-448a-942e-61bfd6a95fa0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:22.101575 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d9cf04d5-8f90-448a-942e-61bfd6a95fa0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:22.383191 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:22.383785 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:22.391029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:22.391831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:22.392959 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:22.393546 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:22.608704 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:22.623551 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:22.627678 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:22.630100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4a484aec-65bc-4164-93fe-a026a1e449dd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.252452 Aug 04 13:58:22.640531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 167/316] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:22 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:22.641555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-306a5030-903a-45a2-8a81-71ad9d242988 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:22.643094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-306a5030-903a-45a2-8a81-71ad9d242988 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:22.656030 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-306a5030-903a-45a2-8a81-71ad9d242988 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:22.656619 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-306a5030-903a-45a2-8a81-71ad9d242988 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:22.657664 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-306a5030-903a-45a2-8a81-71ad9d242988 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:22.658140 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-306a5030-903a-45a2-8a81-71ad9d242988 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:22.884122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-306a5030-903a-45a2-8a81-71ad9d242988 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:22.897316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-306a5030-903a-45a2-8a81-71ad9d242988 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.263946 Aug 04 13:58:22.903890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 168/317] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:22 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:22.968339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d9cf04d5-8f90-448a-942e-61bfd6a95fa0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889296 Aug 04 13:58:22.988360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 150/318] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 13:58:22 2021] POST /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:23.655980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:23.656923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:23.663015 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:23.663563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:23.664435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:23.664875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:23.810065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:23.828729 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:23.831425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:23.836591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7d9e28b5-c255-4300-9181-3d84af3ae3d2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.182054 Aug 04 13:58:23.837246 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 169/319] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:23 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:23.891810 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-581e0346-35d1-4658-863c-ad5394b55126 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:23.893300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-581e0346-35d1-4658-863c-ad5394b55126 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:23.896910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-9e78f3f6-514a-4a89-b416-7dbf282b8403 req-7aeb1434-0be0-4aa3-96b8-9137c69b99cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1349a3-e392-480b-84ed-d851137f5a0c", "tag": "c35367a7-2079-4165-ae77-a51b6092b849"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:23.900716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:23.900716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:58:23.901726 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-581e0346-35d1-4658-863c-ad5394b55126 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:23.902283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-581e0346-35d1-4658-863c-ad5394b55126 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:23.903181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-581e0346-35d1-4658-863c-ad5394b55126 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:23.903721 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-581e0346-35d1-4658-863c-ad5394b55126 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:23.912911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-9e78f3f6-514a-4a89-b416-7dbf282b8403 req-7aeb1434-0be0-4aa3-96b8-9137c69b99cc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:23.913259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-9e78f3f6-514a-4a89-b416-7dbf282b8403 req-7aeb1434-0be0-4aa3-96b8-9137c69b99cc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:23.926877 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-9e78f3f6-514a-4a89-b416-7dbf282b8403 req-7aeb1434-0be0-4aa3-96b8-9137c69b99cc service nova] Creating event network-changed:c35367a7-2079-4165-ae77-a51b6092b849 for instance 2c1349a3-e392-480b-84ed-d851137f5a0c on hv-cinder-79264 Aug 04 13:58:23.932872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-9e78f3f6-514a-4a89-b416-7dbf282b8403 req-7aeb1434-0be0-4aa3-96b8-9137c69b99cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040581 Aug 04 13:58:23.933568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 170/320] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:58:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:23.940842 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-75e127b2-8caa-4129-93c1-f3e25576baf9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:23.941699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-75e127b2-8caa-4129-93c1-f3e25576baf9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:23.951102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75e127b2-8caa-4129-93c1-f3e25576baf9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:23.951764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75e127b2-8caa-4129-93c1-f3e25576baf9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:23.953351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75e127b2-8caa-4129-93c1-f3e25576baf9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:23.953883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75e127b2-8caa-4129-93c1-f3e25576baf9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:24.172587 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-75e127b2-8caa-4129-93c1-f3e25576baf9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:24.179836 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-75e127b2-8caa-4129-93c1-f3e25576baf9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.243983 Aug 04 13:58:24.180911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 171/321] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:23 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:24.865210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:24.865797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:24.872756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:24.873684 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:24.875180 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:24.875703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:25.032804 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:25.041594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:25.043230 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:25.044586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-de314c94-5c4b-424f-b36b-fc8c76aaaa13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.183385 Aug 04 13:58:25.045376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 172/322] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:24 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:25.215519 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a525913c-6110-49dc-99b9-5edcc57d8996 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:25.216852 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a525913c-6110-49dc-99b9-5edcc57d8996 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:25.231392 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a525913c-6110-49dc-99b9-5edcc57d8996 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:25.231836 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a525913c-6110-49dc-99b9-5edcc57d8996 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:25.233322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a525913c-6110-49dc-99b9-5edcc57d8996 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:25.234501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a525913c-6110-49dc-99b9-5edcc57d8996 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:25.390470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a525913c-6110-49dc-99b9-5edcc57d8996 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:25.403159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a525913c-6110-49dc-99b9-5edcc57d8996 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.194055 Aug 04 13:58:25.404258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 173/323] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:25 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:26.064850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:26.065572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:26.072134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:26.072604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:26.073422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:26.073846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:26.215370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:26.231978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:26.234024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:26.235153 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-677ed211-845c-4547-836d-5d514cebdf9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.174410 Aug 04 13:58:26.235918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 174/324] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:26 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:26.423013 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6d5d3bc6-472f-4cea-b48b-6df36faf3f2c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:26.423725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6d5d3bc6-472f-4cea-b48b-6df36faf3f2c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:26.430165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d5d3bc6-472f-4cea-b48b-6df36faf3f2c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:26.430604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d5d3bc6-472f-4cea-b48b-6df36faf3f2c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:26.431377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d5d3bc6-472f-4cea-b48b-6df36faf3f2c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:26.431803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d5d3bc6-472f-4cea-b48b-6df36faf3f2c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:26.564483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6d5d3bc6-472f-4cea-b48b-6df36faf3f2c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:26.572154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6d5d3bc6-472f-4cea-b48b-6df36faf3f2c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.153315 Aug 04 13:58:26.572753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 175/325] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:26 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:27.258901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:27.259529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:27.265583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:27.265975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:27.266753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:27.267197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:27.394340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:27.402200 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:27.403675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:27.404812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-806a7c6e-8a6b-4da2-8a57-1b610895ffc7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.149598 Aug 04 13:58:27.406347 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 176/326] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:27 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:27.590493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1e309a14-5f28-4c47-9a2c-c3602e49f96d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:27.590996 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1e309a14-5f28-4c47-9a2c-c3602e49f96d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:27.597881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e309a14-5f28-4c47-9a2c-c3602e49f96d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:27.598313 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e309a14-5f28-4c47-9a2c-c3602e49f96d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:27.599076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e309a14-5f28-4c47-9a2c-c3602e49f96d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:27.599498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e309a14-5f28-4c47-9a2c-c3602e49f96d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:27.733931 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1e309a14-5f28-4c47-9a2c-c3602e49f96d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:27.743472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1e309a14-5f28-4c47-9a2c-c3602e49f96d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.156560 Aug 04 13:58:27.744346 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 177/327] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:27 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:28.423542 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:28.424229 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:28.430278 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:28.430756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:28.431604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:28.431961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:28.560760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:28.569145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:28.570633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:28.571976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d710ec99-d90a-4963-b6f7-1b87b660a52e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1406 microversion: 2.20 time: 0.153085 Aug 04 13:58:28.578423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 178/328] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:28 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:58:28.617077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-581e0346-35d1-4658-863c-ad5394b55126 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 4.732279 Aug 04 13:58:28.620399 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 151/329] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:23 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 4734 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:58:28.763153 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-46e80181-d02e-4b83-8c97-b0c6937b7203 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:28.763748 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-46e80181-d02e-4b83-8c97-b0c6937b7203 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:28.770503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-46e80181-d02e-4b83-8c97-b0c6937b7203 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:28.771006 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-46e80181-d02e-4b83-8c97-b0c6937b7203 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:28.771767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-46e80181-d02e-4b83-8c97-b0c6937b7203 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:28.772195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-46e80181-d02e-4b83-8c97-b0c6937b7203 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:28.908500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-46e80181-d02e-4b83-8c97-b0c6937b7203 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:28.916519 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-46e80181-d02e-4b83-8c97-b0c6937b7203 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1322 microversion: 2.1 time: 0.156906 Aug 04 13:58:28.917067 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 179/330] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:28 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:29.591456 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:29.592151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:29.602062 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:29.602625 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:29.603641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:29.604585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:29.628504 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ab03c29b-c6b9-421b-9ea0-6a42c579ff42 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:29.630192 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ab03c29b-c6b9-421b-9ea0-6a42c579ff42 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:29.636671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ab03c29b-c6b9-421b-9ea0-6a42c579ff42 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:29.637361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ab03c29b-c6b9-421b-9ea0-6a42c579ff42 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:29.638298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ab03c29b-c6b9-421b-9ea0-6a42c579ff42 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:29.638886 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ab03c29b-c6b9-421b-9ea0-6a42c579ff42 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:29.811319 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ab03c29b-c6b9-421b-9ea0-6a42c579ff42 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.186622 Aug 04 13:58:29.812037 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 180/331] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:29 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:58:29.826042 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:29.837503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:29.839344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:29.840557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b786afa6-14d6-4f7d-b699-9f896d1f2639 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1598 microversion: 2.20 time: 0.253459 Aug 04 13:58:29.841392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 152/332] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 13:58:29 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1598 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:29.862136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bc296f26-2e71-44f8-830c-40bae16fca85 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:29.862136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bc296f26-2e71-44f8-830c-40bae16fca85 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:29.869393 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc296f26-2e71-44f8-830c-40bae16fca85 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:29.869920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc296f26-2e71-44f8-830c-40bae16fca85 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:29.870706 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc296f26-2e71-44f8-830c-40bae16fca85 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:29.871132 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc296f26-2e71-44f8-830c-40bae16fca85 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:29.935513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1a1db96e-d894-4134-a8dc-61dc1572bddb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:29.936529 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1a1db96e-d894-4134-a8dc-61dc1572bddb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:29.944262 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a1db96e-d894-4134-a8dc-61dc1572bddb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:29.945975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a1db96e-d894-4134-a8dc-61dc1572bddb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:29.947973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a1db96e-d894-4134-a8dc-61dc1572bddb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:29.949069 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a1db96e-d894-4134-a8dc-61dc1572bddb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:29.971522 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bc296f26-2e71-44f8-830c-40bae16fca85 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116230 Aug 04 13:58:29.972538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 181/333] 10.222.0.43 () {60 vars in 1316 bytes} [Wed Aug 4 13:58:29 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:30.101952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1a1db96e-d894-4134-a8dc-61dc1572bddb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:30.119879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1a1db96e-d894-4134-a8dc-61dc1572bddb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1516 microversion: 2.1 time: 0.188260 Aug 04 13:58:30.120732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 153/334] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:29 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:30.152014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d8ea872c-bfed-4cf2-ae43-a75ac0d4719b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:30.153125 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d8ea872c-bfed-4cf2-ae43-a75ac0d4719b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:30.163108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8ea872c-bfed-4cf2-ae43-a75ac0d4719b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:30.163108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8ea872c-bfed-4cf2-ae43-a75ac0d4719b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:30.163108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8ea872c-bfed-4cf2-ae43-a75ac0d4719b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:30.163108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8ea872c-bfed-4cf2-ae43-a75ac0d4719b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:30.196726 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-d8ea872c-bfed-4cf2-ae43-a75ac0d4719b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lazy-loading 'flavor' on Instance uuid d1daa517-619e-4605-8c20-906b075afd41 {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:58:30.336672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d8ea872c-bfed-4cf2-ae43-a75ac0d4719b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41/action" status: 200 len: 32 microversion: 2.1 time: 0.197721 Aug 04 13:58:30.342023 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 182/335] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:30 2021] POST /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:30.351935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-023870aa-04e4-4d02-9420-38f5c10599f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:30.353264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-023870aa-04e4-4d02-9420-38f5c10599f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:30.365162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-023870aa-04e4-4d02-9420-38f5c10599f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:30.366817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-023870aa-04e4-4d02-9420-38f5c10599f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:30.368695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-023870aa-04e4-4d02-9420-38f5c10599f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:30.369617 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-023870aa-04e4-4d02-9420-38f5c10599f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:30.666457 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-023870aa-04e4-4d02-9420-38f5c10599f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:30.691898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-023870aa-04e4-4d02-9420-38f5c10599f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.347348 Aug 04 13:58:30.694593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 154/336] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:30 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:30.827907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1489e3ce-794e-45fa-9360-74f808518d3a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:30.829631 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1489e3ce-794e-45fa-9360-74f808518d3a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:30.836692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1489e3ce-794e-45fa-9360-74f808518d3a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:30.837613 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1489e3ce-794e-45fa-9360-74f808518d3a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:30.838885 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1489e3ce-794e-45fa-9360-74f808518d3a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:30.839526 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1489e3ce-794e-45fa-9360-74f808518d3a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:30.969301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1489e3ce-794e-45fa-9360-74f808518d3a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.144073 Aug 04 13:58:30.974731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 183/337] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:30 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:58:31.716551 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9d6ec7bd-c6cf-4517-b0a6-5fbbb3c27ef7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:31.718272 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9d6ec7bd-c6cf-4517-b0a6-5fbbb3c27ef7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:31.726375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d6ec7bd-c6cf-4517-b0a6-5fbbb3c27ef7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:31.727128 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d6ec7bd-c6cf-4517-b0a6-5fbbb3c27ef7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:31.728929 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d6ec7bd-c6cf-4517-b0a6-5fbbb3c27ef7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:31.729589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d6ec7bd-c6cf-4517-b0a6-5fbbb3c27ef7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:31.985372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f3e782ce-8bb8-4acc-ab0a-0d42731cc98b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:31.987358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f3e782ce-8bb8-4acc-ab0a-0d42731cc98b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:32.009094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f3e782ce-8bb8-4acc-ab0a-0d42731cc98b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:32.010490 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f3e782ce-8bb8-4acc-ab0a-0d42731cc98b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:32.013355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f3e782ce-8bb8-4acc-ab0a-0d42731cc98b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:32.016275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f3e782ce-8bb8-4acc-ab0a-0d42731cc98b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:32.082607 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9d6ec7bd-c6cf-4517-b0a6-5fbbb3c27ef7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:32.106123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9d6ec7bd-c6cf-4517-b0a6-5fbbb3c27ef7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.393161 Aug 04 13:58:32.114921 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 155/338] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:31 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:32.130904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-731287242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866386038", "security_groups": [{"name": "tempest-secgroup-smoke-1201868746"}], "block_device_mapping_v2": [{"uuid": "884c3a77-016e-4238-9ecc-89df41e308ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77be53e2-6c8e-4582-aec6-d3baff66b203"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:32.136082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f3e782ce-8bb8-4acc-ab0a-0d42731cc98b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.156386 Aug 04 13:58:32.137262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 184/339] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:31 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:58:32.262647 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-695f0dc2-41fe-45f5-8cdb-6d87d2c5dfcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:32.264930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-695f0dc2-41fe-45f5-8cdb-6d87d2c5dfcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:32.280054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-695f0dc2-41fe-45f5-8cdb-6d87d2c5dfcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:32.280882 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-695f0dc2-41fe-45f5-8cdb-6d87d2c5dfcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:32.282155 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-695f0dc2-41fe-45f5-8cdb-6d87d2c5dfcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:32.282575 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-695f0dc2-41fe-45f5-8cdb-6d87d2c5dfcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:32.391329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] validate_networks() for [('77be53e2-6c8e-4582-aec6-d3baff66b203', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:58:32.400838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-695f0dc2-41fe-45f5-8cdb-6d87d2c5dfcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.143052 Aug 04 13:58:32.401480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 185/340] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:32 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:32.407243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-f71dff64-7422-4696-851f-eea11b84c9a9 req-c4717cdb-455a-4b77-9cc2-41d0904b943e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a6e241-9234-4ca1-b4ca-7b90733ab705", "tag": "828cc1c2-4556-4cd2-a0e7-2ed9383548e4"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:32.408834 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:32.408834 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:58:32.419153 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-f71dff64-7422-4696-851f-eea11b84c9a9 req-c4717cdb-455a-4b77-9cc2-41d0904b943e service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:32.419753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-f71dff64-7422-4696-851f-eea11b84c9a9 req-c4717cdb-455a-4b77-9cc2-41d0904b943e service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:32.433521 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-f71dff64-7422-4696-851f-eea11b84c9a9 req-c4717cdb-455a-4b77-9cc2-41d0904b943e service nova] Creating event network-changed:828cc1c2-4556-4cd2-a0e7-2ed9383548e4 for instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 on hv-cinder-79264 Aug 04 13:58:32.440093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-f71dff64-7422-4696-851f-eea11b84c9a9 req-c4717cdb-455a-4b77-9cc2-41d0904b943e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037087 Aug 04 13:58:32.441122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 186/341] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:58:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:33.132120 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dc2f4166-fad3-4500-9dd9-35d5b1c9ad66 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:33.136167 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-dc2f4166-fad3-4500-9dd9-35d5b1c9ad66 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:33.151131 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dc2f4166-fad3-4500-9dd9-35d5b1c9ad66 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:33.152936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dc2f4166-fad3-4500-9dd9-35d5b1c9ad66 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:33.155270 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dc2f4166-fad3-4500-9dd9-35d5b1c9ad66 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:33.157197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dc2f4166-fad3-4500-9dd9-35d5b1c9ad66 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:33.484293 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:58:33.485651 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:58:33.486142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:58:33.486550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:58:33.486951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:58:33.495268 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dc2f4166-fad3-4500-9dd9-35d5b1c9ad66 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:33.513621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-dc2f4166-fad3-4500-9dd9-35d5b1c9ad66 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.390502 Aug 04 13:58:33.516323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 187/342] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:33 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:33.522414 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:33.523143 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:33.524016 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:33.524733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:33.534947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ad2aa714-377c-4708-8a72-e5b5d0e7b871 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:33.536780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ad2aa714-377c-4708-8a72-e5b5d0e7b871 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:33.557167 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ad2aa714-377c-4708-8a72-e5b5d0e7b871 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:33.558316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ad2aa714-377c-4708-8a72-e5b5d0e7b871 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:33.563821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ad2aa714-377c-4708-8a72-e5b5d0e7b871 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:33.565611 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ad2aa714-377c-4708-8a72-e5b5d0e7b871 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:33.618807 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:58:33.643334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for user 829a37a970b04d14a0b13b5d54ae2f24 and project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:58:33.782883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ad2aa714-377c-4708-8a72-e5b5d0e7b871 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.263546 Aug 04 13:58:33.791705 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 188/343] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:33 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:33.797792 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-09d06ad2-a913-49d1-ad33-602a076e4ac8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:33.799515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-09d06ad2-a913-49d1-ad33-602a076e4ac8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:33.823443 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-09d06ad2-a913-49d1-ad33-602a076e4ac8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:33.824268 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-09d06ad2-a913-49d1-ad33-602a076e4ac8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:33.825673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-09d06ad2-a913-49d1-ad33-602a076e4ac8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:33.826452 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-09d06ad2-a913-49d1-ad33-602a076e4ac8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:33.842156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:58:33.846268 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='884c3a77-016e-4238-9ecc-89df41e308ed',volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:58:34.027262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-09d06ad2-a913-49d1-ad33-602a076e4ac8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.237458 Aug 04 13:58:34.031184 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 189/344] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:33 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:34.129034 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e9e54f34-48d9-47c4-87a9-f408e72f109d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.011966 Aug 04 13:58:34.129875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 156/345] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:58:32 2021] POST /compute/v2.1/servers => generated 406 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:58:34.146432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a2571c33-af97-4651-9fd8-cbe20f8bf18d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:34.147781 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a2571c33-af97-4651-9fd8-cbe20f8bf18d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:34.227230 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a2571c33-af97-4651-9fd8-cbe20f8bf18d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:34.235205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a2571c33-af97-4651-9fd8-cbe20f8bf18d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1094 microversion: 2.1 time: 0.097944 Aug 04 13:58:34.235884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 190/346] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:34 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:34.547353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0bb4e029-7c5d-4171-82c8-27677684a661 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:34.548823 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0bb4e029-7c5d-4171-82c8-27677684a661 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:34.566564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0bb4e029-7c5d-4171-82c8-27677684a661 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:34.567375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0bb4e029-7c5d-4171-82c8-27677684a661 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:34.569197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0bb4e029-7c5d-4171-82c8-27677684a661 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:34.570124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0bb4e029-7c5d-4171-82c8-27677684a661 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:34.790439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0bb4e029-7c5d-4171-82c8-27677684a661 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:34.803454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b921afa8-409d-4b37-9494-230380de5eb3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:34.807928 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b921afa8-409d-4b37-9494-230380de5eb3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:34.822464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0bb4e029-7c5d-4171-82c8-27677684a661 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.282806 Aug 04 13:58:34.824329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b921afa8-409d-4b37-9494-230380de5eb3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:34.824515 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 157/347] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:34 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:34.825296 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b921afa8-409d-4b37-9494-230380de5eb3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:34.826153 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b921afa8-409d-4b37-9494-230380de5eb3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:34.826592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b921afa8-409d-4b37-9494-230380de5eb3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:35.024974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b921afa8-409d-4b37-9494-230380de5eb3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.228078 Aug 04 13:58:35.026555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 191/348] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:34 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:35.042072 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d2c746cb-9d27-4dbd-934d-e64bf3ec2932 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:35.043568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d2c746cb-9d27-4dbd-934d-e64bf3ec2932 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:35.065709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2c746cb-9d27-4dbd-934d-e64bf3ec2932 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:35.066166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2c746cb-9d27-4dbd-934d-e64bf3ec2932 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:35.066980 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2c746cb-9d27-4dbd-934d-e64bf3ec2932 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:35.067416 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d2c746cb-9d27-4dbd-934d-e64bf3ec2932 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:35.260552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c21a2959-fe74-4b5c-952c-41192a9e7a00 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:35.262197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c21a2959-fe74-4b5c-952c-41192a9e7a00 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:35.267307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d2c746cb-9d27-4dbd-934d-e64bf3ec2932 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.230466 Aug 04 13:58:35.272508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 158/349] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:35 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:35.280447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c21a2959-fe74-4b5c-952c-41192a9e7a00 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:35.282833 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c21a2959-fe74-4b5c-952c-41192a9e7a00 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:35.285563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c21a2959-fe74-4b5c-952c-41192a9e7a00 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:35.286414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c21a2959-fe74-4b5c-952c-41192a9e7a00 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:35.380275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c21a2959-fe74-4b5c-952c-41192a9e7a00 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:35.389141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c21a2959-fe74-4b5c-952c-41192a9e7a00 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1192 microversion: 2.1 time: 0.138290 Aug 04 13:58:35.390284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 192/350] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:35 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1192 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:35.850890 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-627c516e-99b2-42eb-8936-91d3e9414997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:35.852061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-627c516e-99b2-42eb-8936-91d3e9414997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:35.863667 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-627c516e-99b2-42eb-8936-91d3e9414997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:35.864179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-627c516e-99b2-42eb-8936-91d3e9414997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:35.865422 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-627c516e-99b2-42eb-8936-91d3e9414997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:35.866982 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-627c516e-99b2-42eb-8936-91d3e9414997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:36.039691 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-07364ca8-102a-41f8-b3c3-43e50ad64e33 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:36.040739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-07364ca8-102a-41f8-b3c3-43e50ad64e33 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:36.051220 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07364ca8-102a-41f8-b3c3-43e50ad64e33 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:36.052327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07364ca8-102a-41f8-b3c3-43e50ad64e33 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:36.053056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07364ca8-102a-41f8-b3c3-43e50ad64e33 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:36.053507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07364ca8-102a-41f8-b3c3-43e50ad64e33 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:36.086403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-627c516e-99b2-42eb-8936-91d3e9414997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:36.113161 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-627c516e-99b2-42eb-8936-91d3e9414997 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.269517 Aug 04 13:58:36.115307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 159/351] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:35 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:36.208007 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-07364ca8-102a-41f8-b3c3-43e50ad64e33 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.172191 Aug 04 13:58:36.216318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 193/352] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:36 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:36.279711 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f03b0655-f5b2-4457-a68f-5ad539662d24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:36.281314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f03b0655-f5b2-4457-a68f-5ad539662d24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:36.311071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f03b0655-f5b2-4457-a68f-5ad539662d24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:36.313524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f03b0655-f5b2-4457-a68f-5ad539662d24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:36.314855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f03b0655-f5b2-4457-a68f-5ad539662d24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:36.315885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f03b0655-f5b2-4457-a68f-5ad539662d24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:36.418532 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f1eed900-ffbf-458d-8548-a40fbc0b02ac tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:36.420160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f1eed900-ffbf-458d-8548-a40fbc0b02ac tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:36.428627 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f1eed900-ffbf-458d-8548-a40fbc0b02ac tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:36.429585 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f1eed900-ffbf-458d-8548-a40fbc0b02ac tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:36.430462 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f1eed900-ffbf-458d-8548-a40fbc0b02ac tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:36.430968 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f1eed900-ffbf-458d-8548-a40fbc0b02ac tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:36.515352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f03b0655-f5b2-4457-a68f-5ad539662d24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.238483 Aug 04 13:58:36.515352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 160/353] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:36 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:36.559611 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f1eed900-ffbf-458d-8548-a40fbc0b02ac tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:36.578455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f1eed900-ffbf-458d-8548-a40fbc0b02ac tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1210 microversion: 2.1 time: 0.166738 Aug 04 13:58:36.581962 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 194/354] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:36 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:37.137501 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a1526270-243a-4c53-a9f3-f285d6382a1a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:37.138752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a1526270-243a-4c53-a9f3-f285d6382a1a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:37.152636 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1526270-243a-4c53-a9f3-f285d6382a1a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.154333 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1526270-243a-4c53-a9f3-f285d6382a1a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.157192 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1526270-243a-4c53-a9f3-f285d6382a1a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.159128 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1526270-243a-4c53-a9f3-f285d6382a1a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.232418 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9626a1ed-4d73-432e-bcb5-53f49cfdec19 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:37.234650 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9626a1ed-4d73-432e-bcb5-53f49cfdec19 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:37.244690 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9626a1ed-4d73-432e-bcb5-53f49cfdec19 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.245710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9626a1ed-4d73-432e-bcb5-53f49cfdec19 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.247179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9626a1ed-4d73-432e-bcb5-53f49cfdec19 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.247946 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9626a1ed-4d73-432e-bcb5-53f49cfdec19 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.393000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9626a1ed-4d73-432e-bcb5-53f49cfdec19 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.171162 Aug 04 13:58:37.395741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 195/355] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:37 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:37.533706 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a505fa06-edfd-480c-8864-fdf5b76dc318 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:37.535691 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a505fa06-edfd-480c-8864-fdf5b76dc318 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:37.546139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a505fa06-edfd-480c-8864-fdf5b76dc318 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.554897 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a505fa06-edfd-480c-8864-fdf5b76dc318 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.557483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a505fa06-edfd-480c-8864-fdf5b76dc318 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.558635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a505fa06-edfd-480c-8864-fdf5b76dc318 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.755600 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a505fa06-edfd-480c-8864-fdf5b76dc318 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.227256 Aug 04 13:58:37.757366 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 196/356] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:37 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:37.770102 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a1526270-243a-4c53-a9f3-f285d6382a1a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:37.770964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-38c27c05-23ea-43d7-9e4f-54b04488df10 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:37.772919 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-38c27c05-23ea-43d7-9e4f-54b04488df10 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:37.828679 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a1526270-243a-4c53-a9f3-f285d6382a1a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.699201 Aug 04 13:58:37.829668 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 161/357] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:37 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:37.843249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-38c27c05-23ea-43d7-9e4f-54b04488df10 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.845153 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-38c27c05-23ea-43d7-9e4f-54b04488df10 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.849375 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-38c27c05-23ea-43d7-9e4f-54b04488df10 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.851550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-38c27c05-23ea-43d7-9e4f-54b04488df10 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.858019 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a60b6880-3005-4d58-82b2-2df16869ad9b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:37.858911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a60b6880-3005-4d58-82b2-2df16869ad9b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:37.880514 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a60b6880-3005-4d58-82b2-2df16869ad9b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.880939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a60b6880-3005-4d58-82b2-2df16869ad9b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:37.883720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a60b6880-3005-4d58-82b2-2df16869ad9b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:37.886240 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a60b6880-3005-4d58-82b2-2df16869ad9b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.026014 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a60b6880-3005-4d58-82b2-2df16869ad9b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 13:58:38.363188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a60b6880-3005-4d58-82b2-2df16869ad9b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 204 len: 0 microversion: 2.1 time: 0.520760 Aug 04 13:58:38.368349 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 162/358] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 13:58:37 2021] DELETE /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:58:38.383461 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-141f2a3c-4ee4-4dbd-9995-e1ef5902340a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:38.385457 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-141f2a3c-4ee4-4dbd-9995-e1ef5902340a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:38.394492 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-38c27c05-23ea-43d7-9e4f-54b04488df10 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:38.400794 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-141f2a3c-4ee4-4dbd-9995-e1ef5902340a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:38.401393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-141f2a3c-4ee4-4dbd-9995-e1ef5902340a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.403494 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-141f2a3c-4ee4-4dbd-9995-e1ef5902340a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:38.404274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-141f2a3c-4ee4-4dbd-9995-e1ef5902340a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.427318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-38c27c05-23ea-43d7-9e4f-54b04488df10 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1278 microversion: 2.1 time: 0.665337 Aug 04 13:58:38.434849 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 197/359] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:37 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1278 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:38.446608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-104b7e01-deda-4c97-a495-81442e35dc1f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:38.448124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-104b7e01-deda-4c97-a495-81442e35dc1f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:38.467560 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-104b7e01-deda-4c97-a495-81442e35dc1f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:38.468965 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-104b7e01-deda-4c97-a495-81442e35dc1f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.470927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-104b7e01-deda-4c97-a495-81442e35dc1f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:38.472493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-104b7e01-deda-4c97-a495-81442e35dc1f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.676170 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-104b7e01-deda-4c97-a495-81442e35dc1f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.237875 Aug 04 13:58:38.678338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 198/360] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:38 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:38.776301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3d0eb683-4911-4933-9feb-674b58dfd357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:38.778163 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3d0eb683-4911-4933-9feb-674b58dfd357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:38.794516 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d0eb683-4911-4933-9feb-674b58dfd357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:38.794516 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d0eb683-4911-4933-9feb-674b58dfd357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.795334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d0eb683-4911-4933-9feb-674b58dfd357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:38.797391 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d0eb683-4911-4933-9feb-674b58dfd357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.823141 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-141f2a3c-4ee4-4dbd-9995-e1ef5902340a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:38.833836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-141f2a3c-4ee4-4dbd-9995-e1ef5902340a tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1554 microversion: 2.1 time: 0.460762 Aug 04 13:58:38.845203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 163/361] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:38 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1554 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:38.859468 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-354ded76-c165-42f5-a1c1-5747a16c68e4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:38.860170 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-354ded76-c165-42f5-a1c1-5747a16c68e4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:38.867357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-354ded76-c165-42f5-a1c1-5747a16c68e4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:38.867932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-354ded76-c165-42f5-a1c1-5747a16c68e4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.868947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-354ded76-c165-42f5-a1c1-5747a16c68e4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:38.869479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-354ded76-c165-42f5-a1c1-5747a16c68e4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:38.925655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3d0eb683-4911-4933-9feb-674b58dfd357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.158261 Aug 04 13:58:38.929854 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 199/362] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:38 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:39.188549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-354ded76-c165-42f5-a1c1-5747a16c68e4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:39.210135 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-354ded76-c165-42f5-a1c1-5747a16c68e4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.354763 Aug 04 13:58:39.213165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 164/363] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:38 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:39.451630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-baf76325-a41d-40ff-a20c-1f8f4ba299fc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:39.452662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-baf76325-a41d-40ff-a20c-1f8f4ba299fc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:39.463889 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baf76325-a41d-40ff-a20c-1f8f4ba299fc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.465572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baf76325-a41d-40ff-a20c-1f8f4ba299fc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:39.467409 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baf76325-a41d-40ff-a20c-1f8f4ba299fc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.468884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baf76325-a41d-40ff-a20c-1f8f4ba299fc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:39.588256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-f65bc181-1fc7-45a9-82b3-38956bcb16a2 req-5a25ff88-7868-4fb8-ac00-0442ae51beff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f674980e-9f84-4659-bbd4-114786775944", "tag": "2291b3bf-fa3c-4988-994b-0bdcb2e3ed75"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:39.590650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:39.590650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:58:39.616894 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-f65bc181-1fc7-45a9-82b3-38956bcb16a2 req-5a25ff88-7868-4fb8-ac00-0442ae51beff service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.623641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-f65bc181-1fc7-45a9-82b3-38956bcb16a2 req-5a25ff88-7868-4fb8-ac00-0442ae51beff service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:39.696166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-f65bc181-1fc7-45a9-82b3-38956bcb16a2 req-5a25ff88-7868-4fb8-ac00-0442ae51beff service nova] Creating event network-changed:2291b3bf-fa3c-4988-994b-0bdcb2e3ed75 for instance f674980e-9f84-4659-bbd4-114786775944 on hv-cinder-79264 Aug 04 13:58:39.723093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-f65bc181-1fc7-45a9-82b3-38956bcb16a2 req-5a25ff88-7868-4fb8-ac00-0442ae51beff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135034 Aug 04 13:58:39.724495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 165/364] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:58:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:39.739734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-31b0085f-c449-4974-a524-dbafeb75825b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:39.741175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-31b0085f-c449-4974-a524-dbafeb75825b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:39.759417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-31b0085f-c449-4974-a524-dbafeb75825b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.762353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-31b0085f-c449-4974-a524-dbafeb75825b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:39.767740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-31b0085f-c449-4974-a524-dbafeb75825b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.770997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-31b0085f-c449-4974-a524-dbafeb75825b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:39.899063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-baf76325-a41d-40ff-a20c-1f8f4ba299fc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:39.918347 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-baf76325-a41d-40ff-a20c-1f8f4ba299fc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1278 microversion: 2.1 time: 0.470571 Aug 04 13:58:39.920183 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 200/365] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:39 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1278 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:39.929580 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d3ac0052-55c7-4870-ac79-85392ce1d37b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:39.931338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d3ac0052-55c7-4870-ac79-85392ce1d37b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:39.938162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-31b0085f-c449-4974-a524-dbafeb75825b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.210600 Aug 04 13:58:39.938846 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 166/366] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:39 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:39.945226 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4ee196f1-cdda-4ab4-8b66-e3fed2a9fe0c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:39.946318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4ee196f1-cdda-4ab4-8b66-e3fed2a9fe0c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:39.953831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d3ac0052-55c7-4870-ac79-85392ce1d37b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.955292 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d3ac0052-55c7-4870-ac79-85392ce1d37b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:39.957122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d3ac0052-55c7-4870-ac79-85392ce1d37b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.958045 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d3ac0052-55c7-4870-ac79-85392ce1d37b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:39.971776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4ee196f1-cdda-4ab4-8b66-e3fed2a9fe0c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.972271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4ee196f1-cdda-4ab4-8b66-e3fed2a9fe0c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:39.973266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4ee196f1-cdda-4ab4-8b66-e3fed2a9fe0c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:39.973808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4ee196f1-cdda-4ab4-8b66-e3fed2a9fe0c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:40.152800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4ee196f1-cdda-4ab4-8b66-e3fed2a9fe0c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.212049 Aug 04 13:58:40.154179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 167/367] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:39 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:40.226340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d3ac0052-55c7-4870-ac79-85392ce1d37b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:40.244334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d3ac0052-55c7-4870-ac79-85392ce1d37b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1554 microversion: 2.1 time: 0.322202 Aug 04 13:58:40.245848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 201/368] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:39 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1554 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:40.247634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-520c22f8-6e24-46b6-9fc9-69bc4b3027cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:40.250967 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-520c22f8-6e24-46b6-9fc9-69bc4b3027cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:40.263932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-520c22f8-6e24-46b6-9fc9-69bc4b3027cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:40.265254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-520c22f8-6e24-46b6-9fc9-69bc4b3027cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:40.266977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-520c22f8-6e24-46b6-9fc9-69bc4b3027cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:40.267993 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-520c22f8-6e24-46b6-9fc9-69bc4b3027cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:40.653638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-520c22f8-6e24-46b6-9fc9-69bc4b3027cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:40.671407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-520c22f8-6e24-46b6-9fc9-69bc4b3027cc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.431907 Aug 04 13:58:40.673425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 168/369] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:40 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:40.954245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-19c7d699-78de-4212-b2f5-60c9749eb7b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:40.955460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-19c7d699-78de-4212-b2f5-60c9749eb7b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:40.959031 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8519dd54-7f32-4690-b0d9-d03a9ae30285 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:40.962189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8519dd54-7f32-4690-b0d9-d03a9ae30285 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:40.972430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8519dd54-7f32-4690-b0d9-d03a9ae30285 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:40.973307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8519dd54-7f32-4690-b0d9-d03a9ae30285 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:40.983611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8519dd54-7f32-4690-b0d9-d03a9ae30285 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:40.984342 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8519dd54-7f32-4690-b0d9-d03a9ae30285 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:40.987338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19c7d699-78de-4212-b2f5-60c9749eb7b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:40.987833 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19c7d699-78de-4212-b2f5-60c9749eb7b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:40.988737 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19c7d699-78de-4212-b2f5-60c9749eb7b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:40.989160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19c7d699-78de-4212-b2f5-60c9749eb7b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:41.152109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8519dd54-7f32-4690-b0d9-d03a9ae30285 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 14 microversion: 2.1 time: 0.196343 Aug 04 13:58:41.153005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 169/370] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:40 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:58:41.170445 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-645f2618-9a7d-4fe3-a7e8-4388e106ecfa tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:41.172933 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-645f2618-9a7d-4fe3-a7e8-4388e106ecfa tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:41.195280 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-645f2618-9a7d-4fe3-a7e8-4388e106ecfa tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:41.197738 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-645f2618-9a7d-4fe3-a7e8-4388e106ecfa tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:41.197738 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-645f2618-9a7d-4fe3-a7e8-4388e106ecfa tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:41.201346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-645f2618-9a7d-4fe3-a7e8-4388e106ecfa tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:41.304650 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-19c7d699-78de-4212-b2f5-60c9749eb7b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:41.332204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-19c7d699-78de-4212-b2f5-60c9749eb7b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1278 microversion: 2.1 time: 0.396692 Aug 04 13:58:41.333914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 202/371] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:40 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1278 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:41.343907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5b4fdbea-3ed3-445f-9e8e-e977782b501b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:41.345388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5b4fdbea-3ed3-445f-9e8e-e977782b501b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:41.358085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbea-3ed3-445f-9e8e-e977782b501b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:41.365638 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbea-3ed3-445f-9e8e-e977782b501b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:41.367962 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbea-3ed3-445f-9e8e-e977782b501b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:41.375385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbea-3ed3-445f-9e8e-e977782b501b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:41.511107 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-645f2618-9a7d-4fe3-a7e8-4388e106ecfa tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.347866 Aug 04 13:58:41.518225 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 170/372] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:41 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:41.669850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5b4fdbea-3ed3-445f-9e8e-e977782b501b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:41.690807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5b4fdbea-3ed3-445f-9e8e-e977782b501b tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1554 microversion: 2.1 time: 0.354259 Aug 04 13:58:41.692507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 203/373] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:41 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1554 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:41.713450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e9f57fdf-98c1-4167-9ae1-9c727e70cbbd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:41.714444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e9f57fdf-98c1-4167-9ae1-9c727e70cbbd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:41.728273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9f57fdf-98c1-4167-9ae1-9c727e70cbbd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:41.728273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9f57fdf-98c1-4167-9ae1-9c727e70cbbd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:41.728793 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9f57fdf-98c1-4167-9ae1-9c727e70cbbd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:41.729238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9f57fdf-98c1-4167-9ae1-9c727e70cbbd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.000893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e9f57fdf-98c1-4167-9ae1-9c727e70cbbd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:42.009594 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e9f57fdf-98c1-4167-9ae1-9c727e70cbbd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.307364 Aug 04 13:58:42.013709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 171/374] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:41 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:42.168811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cf034d2d-bf41-42be-be57-86a2b9665686 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:42.171528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cf034d2d-bf41-42be-be57-86a2b9665686 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:42.182318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf034d2d-bf41-42be-be57-86a2b9665686 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:42.183755 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf034d2d-bf41-42be-be57-86a2b9665686 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.185366 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf034d2d-bf41-42be-be57-86a2b9665686 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:42.186665 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf034d2d-bf41-42be-be57-86a2b9665686 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.324042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cf034d2d-bf41-42be-be57-86a2b9665686 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 7599 microversion: 2.1 time: 0.161119 Aug 04 13:58:42.327316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 204/375] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:42 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 7599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:42.351506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9319edb7-ab1f-4d33-bf75-c0734e27f1b3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:42.352128 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9319edb7-ab1f-4d33-bf75-c0734e27f1b3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:42.359631 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9319edb7-ab1f-4d33-bf75-c0734e27f1b3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:42.360113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9319edb7-ab1f-4d33-bf75-c0734e27f1b3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.361033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9319edb7-ab1f-4d33-bf75-c0734e27f1b3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:42.361475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9319edb7-ab1f-4d33-bf75-c0734e27f1b3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.540582 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4281eb45-4ab5-4b7a-809e-736a7c5b8dcc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:42.543294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4281eb45-4ab5-4b7a-809e-736a7c5b8dcc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:42.562969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4281eb45-4ab5-4b7a-809e-736a7c5b8dcc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:42.564384 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4281eb45-4ab5-4b7a-809e-736a7c5b8dcc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.566345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4281eb45-4ab5-4b7a-809e-736a7c5b8dcc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:42.573753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9319edb7-ab1f-4d33-bf75-c0734e27f1b3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:42.577725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4281eb45-4ab5-4b7a-809e-736a7c5b8dcc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.598320 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9319edb7-ab1f-4d33-bf75-c0734e27f1b3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1278 microversion: 2.1 time: 0.250213 Aug 04 13:58:42.601931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 172/376] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:42 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:42.723097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f3755e3e-1192-4e1c-95bb-09317ac2fe30 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:42.725967 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f3755e3e-1192-4e1c-95bb-09317ac2fe30 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:42.741641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f3755e3e-1192-4e1c-95bb-09317ac2fe30 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:42.743911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f3755e3e-1192-4e1c-95bb-09317ac2fe30 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.746187 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f3755e3e-1192-4e1c-95bb-09317ac2fe30 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:42.748859 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f3755e3e-1192-4e1c-95bb-09317ac2fe30 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:42.769381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4281eb45-4ab5-4b7a-809e-736a7c5b8dcc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 14 microversion: 2.20 time: 0.246009 Aug 04 13:58:42.773033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 205/377] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:42 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:43.040857 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0b40433c-d847-45c6-8cc5-aec262b9b155 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:43.041904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0b40433c-d847-45c6-8cc5-aec262b9b155 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:43.052057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0b40433c-d847-45c6-8cc5-aec262b9b155 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.053229 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0b40433c-d847-45c6-8cc5-aec262b9b155 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:43.054450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0b40433c-d847-45c6-8cc5-aec262b9b155 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.055326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0b40433c-d847-45c6-8cc5-aec262b9b155 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:43.094858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f3755e3e-1192-4e1c-95bb-09317ac2fe30 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:43.141615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f3755e3e-1192-4e1c-95bb-09317ac2fe30 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1554 microversion: 2.1 time: 0.427846 Aug 04 13:58:43.144329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 173/378] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:42 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1554 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:43.154316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-7de95adb-994a-4088-8d4d-1f86294b60fe req-05e78f6c-4848-444c-b5d3-807fd227e914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9793c85c-8440-4767-a627-2ff4c2c559a2", "name": "network-vif-deleted", "tag": "33fe8983-4030-4984-8c31-c7cfa77508c5"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:43.158995 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:43.158995 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:58:43.175550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7de95adb-994a-4088-8d4d-1f86294b60fe req-05e78f6c-4848-444c-b5d3-807fd227e914 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.192401 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7de95adb-994a-4088-8d4d-1f86294b60fe req-05e78f6c-4848-444c-b5d3-807fd227e914 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:43.214955 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-7de95adb-994a-4088-8d4d-1f86294b60fe req-05e78f6c-4848-444c-b5d3-807fd227e914 service nova] Creating event network-vif-deleted:33fe8983-4030-4984-8c31-c7cfa77508c5 for instance 9793c85c-8440-4767-a627-2ff4c2c559a2 on hv-cinder-79264 Aug 04 13:58:43.227819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-7de95adb-994a-4088-8d4d-1f86294b60fe req-05e78f6c-4848-444c-b5d3-807fd227e914 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080046 Aug 04 13:58:43.229803 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 174/379] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:58:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:43.351371 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9c1b0f49-36cc-44c4-8229-0e1487ca3f77 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:43.353884 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9c1b0f49-36cc-44c4-8229-0e1487ca3f77 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:43.377560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c1b0f49-36cc-44c4-8229-0e1487ca3f77 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.378499 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c1b0f49-36cc-44c4-8229-0e1487ca3f77 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:43.379604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c1b0f49-36cc-44c4-8229-0e1487ca3f77 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.380451 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c1b0f49-36cc-44c4-8229-0e1487ca3f77 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:43.399188 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0b40433c-d847-45c6-8cc5-aec262b9b155 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:43.415383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0b40433c-d847-45c6-8cc5-aec262b9b155 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.379639 Aug 04 13:58:43.415985 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 206/380] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:43 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:43.547165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9c1b0f49-36cc-44c4-8229-0e1487ca3f77 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 12331 microversion: 2.1 time: 0.210037 Aug 04 13:58:43.548470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 175/381] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:43 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 12331 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:58:43.628396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8efbcbca-4715-4b68-9505-2e0f2a029302 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:43.629203 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8efbcbca-4715-4b68-9505-2e0f2a029302 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:43.647907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8efbcbca-4715-4b68-9505-2e0f2a029302 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.648558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8efbcbca-4715-4b68-9505-2e0f2a029302 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:43.649430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8efbcbca-4715-4b68-9505-2e0f2a029302 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.649876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8efbcbca-4715-4b68-9505-2e0f2a029302 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:43.791224 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3e19664d-a576-4f60-8e59-c8ad61baabfd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:43.794568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3e19664d-a576-4f60-8e59-c8ad61baabfd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:43.817454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3e19664d-a576-4f60-8e59-c8ad61baabfd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.820561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3e19664d-a576-4f60-8e59-c8ad61baabfd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:43.823093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3e19664d-a576-4f60-8e59-c8ad61baabfd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:43.824427 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3e19664d-a576-4f60-8e59-c8ad61baabfd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:44.007654 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8efbcbca-4715-4b68-9505-2e0f2a029302 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:44.016400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3e19664d-a576-4f60-8e59-c8ad61baabfd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 1894 microversion: 2.20 time: 0.234582 Aug 04 13:58:44.022097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 176/382] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:43 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 1894 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:44.027577 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8efbcbca-4715-4b68-9505-2e0f2a029302 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1278 microversion: 2.1 time: 0.403716 Aug 04 13:58:44.028498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 207/383] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:43 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1278 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:44.176750 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:44.178175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:44.191045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:44.192983 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:44.195897 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:44.197997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:44.292283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:44.293115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:44.294002 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lazy-loading 'fault' on Instance uuid 9793c85c-8440-4767-a627-2ff4c2c559a2 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:58:44.407546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9483f5dc3e43798cbbf70d55fd5d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921c7539fccf48cb818722af29f9c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:44.430312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f519b928-1158-4b55-aed8-d6b79091842f tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 200 len: 1351 microversion: 2.1 time: 0.257224 Aug 04 13:58:44.430312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 177/384] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:44 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 1351 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:44.447380 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4a062e51-d7b2-44b0-9dc0-df89606f1028 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:44.448648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4a062e51-d7b2-44b0-9dc0-df89606f1028 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:44.460491 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a062e51-d7b2-44b0-9dc0-df89606f1028 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:44.461320 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a062e51-d7b2-44b0-9dc0-df89606f1028 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:44.462997 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a062e51-d7b2-44b0-9dc0-df89606f1028 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:44.464554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a062e51-d7b2-44b0-9dc0-df89606f1028 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:44.579311 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-79d6d509-003a-460b-9d11-517b8ec755f9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:44.581289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-79d6d509-003a-460b-9d11-517b8ec755f9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:44.595253 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-79d6d509-003a-460b-9d11-517b8ec755f9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:44.596055 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-79d6d509-003a-460b-9d11-517b8ec755f9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:44.597696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-79d6d509-003a-460b-9d11-517b8ec755f9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:44.598542 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-79d6d509-003a-460b-9d11-517b8ec755f9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:44.775356 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-79d6d509-003a-460b-9d11-517b8ec755f9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 15064 microversion: 2.1 time: 0.214715 Aug 04 13:58:44.777591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 178/385] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:44 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 15064 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:44.807535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4a062e51-d7b2-44b0-9dc0-df89606f1028 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:44.839796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4a062e51-d7b2-44b0-9dc0-df89606f1028 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.407393 Aug 04 13:58:44.847238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 208/386] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:44 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:45.033328 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-61ceccfd-284c-48c0-a048-f65b4df26c6e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:45.036452 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-61ceccfd-284c-48c0-a048-f65b4df26c6e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:45.053936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6c761896-7231-4d1b-acf8-70856c31d78e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:45.055715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6c761896-7231-4d1b-acf8-70856c31d78e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:45.057001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-61ceccfd-284c-48c0-a048-f65b4df26c6e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:45.059970 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-61ceccfd-284c-48c0-a048-f65b4df26c6e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:45.061503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-61ceccfd-284c-48c0-a048-f65b4df26c6e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:45.066240 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-61ceccfd-284c-48c0-a048-f65b4df26c6e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:45.066455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6c761896-7231-4d1b-acf8-70856c31d78e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:45.066881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6c761896-7231-4d1b-acf8-70856c31d78e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:45.068542 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6c761896-7231-4d1b-acf8-70856c31d78e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:45.069527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6c761896-7231-4d1b-acf8-70856c31d78e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:45.249366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-61ceccfd-284c-48c0-a048-f65b4df26c6e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 8104 microversion: 2.20 time: 0.222260 Aug 04 13:58:45.253277 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 179/387] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:45 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 8104 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:45.301675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6c761896-7231-4d1b-acf8-70856c31d78e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:45.313212 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6c761896-7231-4d1b-acf8-70856c31d78e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1278 microversion: 2.1 time: 0.265435 Aug 04 13:58:45.323827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 209/388] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:45 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:45.463363 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:45.464712 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:45.483168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:45.483168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:45.483168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:45.483168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:45.512082 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] HTTP exception thrown: Instance 9793c85c-8440-4767-a627-2ff4c2c559a2 could not be found. Aug 04 13:58:45.513232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Returning 404 to user: Instance 9793c85c-8440-4767-a627-2ff4c2c559a2 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:58:45.515828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9ec9b629-5b1d-46e3-9818-7154981efb6d tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 404 len: 111 microversion: 2.1 time: 0.059287 Aug 04 13:58:45.517090 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 180/389] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:45 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:58:45.704421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-396259532", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "71fdc264-6c79-4112-8159-7717a7075144"}]}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:45.772416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] validate_networks() for [('71fdc264-6c79-4112-8159-7717a7075144', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:58:45.792350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-478b8c5c-d007-44f3-b3d9-1bff0cc3ddc9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:45.794558 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-478b8c5c-d007-44f3-b3d9-1bff0cc3ddc9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:45.805541 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-478b8c5c-d007-44f3-b3d9-1bff0cc3ddc9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:45.806078 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-478b8c5c-d007-44f3-b3d9-1bff0cc3ddc9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:45.806797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-478b8c5c-d007-44f3-b3d9-1bff0cc3ddc9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:45.807240 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-478b8c5c-d007-44f3-b3d9-1bff0cc3ddc9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:45.981926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-478b8c5c-d007-44f3-b3d9-1bff0cc3ddc9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 17960 microversion: 2.1 time: 0.194776 Aug 04 13:58:45.984308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 181/390] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:45 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 17960 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:58:46.001634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-66b7a046-aea9-4a1f-a803-469bce44cd7c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:46.003209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-66b7a046-aea9-4a1f-a803-469bce44cd7c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:46.015103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-66b7a046-aea9-4a1f-a803-469bce44cd7c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:46.015798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-66b7a046-aea9-4a1f-a803-469bce44cd7c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:46.017981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-66b7a046-aea9-4a1f-a803-469bce44cd7c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:46.019023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-66b7a046-aea9-4a1f-a803-469bce44cd7c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:46.265582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-66b7a046-aea9-4a1f-a803-469bce44cd7c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:46.309915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-66b7a046-aea9-4a1f-a803-469bce44cd7c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.312065 Aug 04 13:58:46.311027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 182/391] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:45 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:46.334972 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1a0714dd-231e-49de-a8e7-ebf8138b992e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:46.336312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1a0714dd-231e-49de-a8e7-ebf8138b992e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:46.345808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a0714dd-231e-49de-a8e7-ebf8138b992e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:46.346972 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a0714dd-231e-49de-a8e7-ebf8138b992e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:46.348715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a0714dd-231e-49de-a8e7-ebf8138b992e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:46.349720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a0714dd-231e-49de-a8e7-ebf8138b992e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:46.501224 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1a0714dd-231e-49de-a8e7-ebf8138b992e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 12367 microversion: 2.20 time: 0.175266 Aug 04 13:58:46.502240 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 183/392] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:46 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 12367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:46.507879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b97bcb1c-e58f-4bf2-9883-2767e32d64f3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:46.509440 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b97bcb1c-e58f-4bf2-9883-2767e32d64f3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:46.524741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b97bcb1c-e58f-4bf2-9883-2767e32d64f3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:46.526837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b97bcb1c-e58f-4bf2-9883-2767e32d64f3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:46.529204 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b97bcb1c-e58f-4bf2-9883-2767e32d64f3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:46.530291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b97bcb1c-e58f-4bf2-9883-2767e32d64f3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:46.794090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:58:46.796520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:58:46.797307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:58:46.797751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:58:46.798173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:58:46.812072 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:46.812943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:46.814516 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:46.815392 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:46.830883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b97bcb1c-e58f-4bf2-9883-2767e32d64f3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:46.842878 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Getting quotas for project 21c2c98b135f4239ab56572ec4a259e1. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:58:46.851837 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Getting quotas for user f19e6144804c449586614d68ec2abe7b and project 21c2c98b135f4239ab56572ec4a259e1. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:58:46.868879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b97bcb1c-e58f-4bf2-9883-2767e32d64f3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1278 microversion: 2.1 time: 0.364459 Aug 04 13:58:46.869603 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 184/393] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:46 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1278 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:46.870665 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:58:46.876065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:58:46.998826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6daeacb0-5b3f-438b-b8d2-300a40d8da03 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:47.000016 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6daeacb0-5b3f-438b-b8d2-300a40d8da03 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:47.007754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6daeacb0-5b3f-438b-b8d2-300a40d8da03 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.008508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6daeacb0-5b3f-438b-b8d2-300a40d8da03 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.009418 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6daeacb0-5b3f-438b-b8d2-300a40d8da03 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.009854 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6daeacb0-5b3f-438b-b8d2-300a40d8da03 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.014659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d84b2e7f-da9d-4640-a7a4-7197344941a8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315807 Aug 04 13:58:47.015307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 210/394] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:58:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:58:47.031907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f8a4bdf4-8b0a-4971-80f5-89380d634e1b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:47.033764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f8a4bdf4-8b0a-4971-80f5-89380d634e1b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:47.156361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f8a4bdf4-8b0a-4971-80f5-89380d634e1b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:47.169925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6daeacb0-5b3f-438b-b8d2-300a40d8da03 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 17960 microversion: 2.1 time: 0.176891 Aug 04 13:58:47.172309 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 185/395] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:46 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 17960 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:47.200298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:47.201216 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:47.206097 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f8a4bdf4-8b0a-4971-80f5-89380d634e1b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1217 microversion: 2.1 time: 0.174659 Aug 04 13:58:47.207252 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 211/396] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:47 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:47.234025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.234797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.235913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.236416 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.265264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] HTTP exception thrown: Instance 9793c85c-8440-4767-a627-2ff4c2c559a2 could not be found. Aug 04 13:58:47.266368 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Returning 404 to user: Instance 9793c85c-8440-4767-a627-2ff4c2c559a2 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:58:47.267323 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-685dab0a-097d-418a-9336-d892c7866b40 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 404 len: 111 microversion: 2.1 time: 0.091393 Aug 04 13:58:47.267966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 186/397] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 13:58:47 2021] DELETE /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:58:47.281932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:47.283075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] [instance: 9793c85c-8440-4767-a627-2ff4c2c559a2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:47.298400 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.299503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.300943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.301725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.334977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] HTTP exception thrown: Instance 9793c85c-8440-4767-a627-2ff4c2c559a2 could not be found. Aug 04 13:58:47.336072 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] Returning 404 to user: Instance 9793c85c-8440-4767-a627-2ff4c2c559a2 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:58:47.337665 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b1633299-a76b-4160-8ced-91b2fd1e0de9 tempest-DeleteServersTestJSON-397781293 tempest-DeleteServersTestJSON-397781293-project] 10.222.0.43 "GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2" status: 404 len: 111 microversion: 2.1 time: 0.062452 Aug 04 13:58:47.338889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f20fbc3d-be19-429b-b832-be0cfb272015 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:47.339642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f20fbc3d-be19-429b-b832-be0cfb272015 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:47.345210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 212/398] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:47 2021] GET /compute/v2.1/servers/9793c85c-8440-4767-a627-2ff4c2c559a2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:58:47.351434 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f20fbc3d-be19-429b-b832-be0cfb272015 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.352122 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f20fbc3d-be19-429b-b832-be0cfb272015 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.353098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f20fbc3d-be19-429b-b832-be0cfb272015 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.354063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f20fbc3d-be19-429b-b832-be0cfb272015 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.525125 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f0844f2d-4d02-48d1-bfbe-44398fb5fa75 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:47.535283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f0844f2d-4d02-48d1-bfbe-44398fb5fa75 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:47.563529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f0844f2d-4d02-48d1-bfbe-44398fb5fa75 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.565387 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f0844f2d-4d02-48d1-bfbe-44398fb5fa75 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.567175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f0844f2d-4d02-48d1-bfbe-44398fb5fa75 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.569096 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f0844f2d-4d02-48d1-bfbe-44398fb5fa75 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.696757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f20fbc3d-be19-429b-b832-be0cfb272015 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:47.707505 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f20fbc3d-be19-429b-b832-be0cfb272015 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.372872 Aug 04 13:58:47.708267 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 187/399] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:47 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:47.832876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f0844f2d-4d02-48d1-bfbe-44398fb5fa75 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 15996 microversion: 2.20 time: 0.320830 Aug 04 13:58:47.836836 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 213/400] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:47 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 15996 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:58:47.895592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a1ed6a0d-cd97-434e-8c41-f38628da476d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:47.896488 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a1ed6a0d-cd97-434e-8c41-f38628da476d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:47.911385 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a0d-cd97-434e-8c41-f38628da476d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.911841 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a0d-cd97-434e-8c41-f38628da476d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:47.912941 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a0d-cd97-434e-8c41-f38628da476d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:47.913610 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a0d-cd97-434e-8c41-f38628da476d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.150112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a1ed6a0d-cd97-434e-8c41-f38628da476d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:48.161146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a1ed6a0d-cd97-434e-8c41-f38628da476d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.269933 Aug 04 13:58:48.162460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 188/401] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:47 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:48.183660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c4607ba9-e717-4869-9ca0-fb817d8424d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:48.184614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c4607ba9-e717-4869-9ca0-fb817d8424d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:48.192704 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4607ba9-e717-4869-9ca0-fb817d8424d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:48.193170 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4607ba9-e717-4869-9ca0-fb817d8424d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.193978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4607ba9-e717-4869-9ca0-fb817d8424d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:48.194425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4607ba9-e717-4869-9ca0-fb817d8424d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.240275 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b2a0857f-6d04-487e-9ea0-0e61f33d7bc6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:48.240829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b2a0857f-6d04-487e-9ea0-0e61f33d7bc6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:48.247925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b2a0857f-6d04-487e-9ea0-0e61f33d7bc6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:48.248412 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b2a0857f-6d04-487e-9ea0-0e61f33d7bc6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.249414 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b2a0857f-6d04-487e-9ea0-0e61f33d7bc6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:48.249851 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b2a0857f-6d04-487e-9ea0-0e61f33d7bc6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.355013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b2a0857f-6d04-487e-9ea0-0e61f33d7bc6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:48.369601 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c4607ba9-e717-4869-9ca0-fb817d8424d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 19446 microversion: 2.1 time: 0.190117 Aug 04 13:58:48.371496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 214/402] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:48 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 19446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:48.378851 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b2a0857f-6d04-487e-9ea0-0e61f33d7bc6 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1269 microversion: 2.1 time: 0.142711 Aug 04 13:58:48.380345 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 189/403] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:48 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:48.734289 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0668ba65-63aa-4620-936c-6b2341e653f7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:48.736191 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0668ba65-63aa-4620-936c-6b2341e653f7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:48.744614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0668ba65-63aa-4620-936c-6b2341e653f7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:48.745710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0668ba65-63aa-4620-936c-6b2341e653f7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.746928 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0668ba65-63aa-4620-936c-6b2341e653f7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:48.747577 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0668ba65-63aa-4620-936c-6b2341e653f7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.845832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f8d674df-6e79-421d-98d4-3e8f9c3e2b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:48.847196 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f8d674df-6e79-421d-98d4-3e8f9c3e2b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:48.854684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8d674df-6e79-421d-98d4-3e8f9c3e2b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:48.855652 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8d674df-6e79-421d-98d4-3e8f9c3e2b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.856860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8d674df-6e79-421d-98d4-3e8f9c3e2b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:48.857544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8d674df-6e79-421d-98d4-3e8f9c3e2b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:48.988137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f8d674df-6e79-421d-98d4-3e8f9c3e2b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 17861 microversion: 2.20 time: 0.147022 Aug 04 13:58:48.992992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 190/404] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:48 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 17861 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:49.097907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0668ba65-63aa-4620-936c-6b2341e653f7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:49.115067 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0668ba65-63aa-4620-936c-6b2341e653f7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.384438 Aug 04 13:58:49.129961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 215/405] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:48 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:49.194903 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b50780d7-2377-4b1f-941d-0c728d8611c3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:49.195641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b50780d7-2377-4b1f-941d-0c728d8611c3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:49.206494 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b50780d7-2377-4b1f-941d-0c728d8611c3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:49.207041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b50780d7-2377-4b1f-941d-0c728d8611c3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:49.207981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b50780d7-2377-4b1f-941d-0c728d8611c3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:49.208508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b50780d7-2377-4b1f-941d-0c728d8611c3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:49.386256 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f08391d9-a7f7-4477-81a8-79ad9dfc73ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:49.387330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f08391d9-a7f7-4477-81a8-79ad9dfc73ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:49.406189 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f08391d9-a7f7-4477-81a8-79ad9dfc73ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:49.406982 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f08391d9-a7f7-4477-81a8-79ad9dfc73ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:49.408369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f08391d9-a7f7-4477-81a8-79ad9dfc73ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:49.409000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f08391d9-a7f7-4477-81a8-79ad9dfc73ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:49.428771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b50780d7-2377-4b1f-941d-0c728d8611c3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:49.454516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b50780d7-2377-4b1f-941d-0c728d8611c3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.260903 Aug 04 13:58:49.456417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 191/406] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:49 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:49.467713 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a2e12686-658e-45dc-ac96-c127160e6314 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:49.470213 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a2e12686-658e-45dc-ac96-c127160e6314 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:49.486334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2e12686-658e-45dc-ac96-c127160e6314 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:49.487863 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2e12686-658e-45dc-ac96-c127160e6314 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:49.490288 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2e12686-658e-45dc-ac96-c127160e6314 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:49.492151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2e12686-658e-45dc-ac96-c127160e6314 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:49.559655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f08391d9-a7f7-4477-81a8-79ad9dfc73ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 21966 microversion: 2.1 time: 0.177114 Aug 04 13:58:49.560301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 216/407] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:49 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 21966 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:58:49.637944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a2e12686-658e-45dc-ac96-c127160e6314 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:49.682046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a2e12686-658e-45dc-ac96-c127160e6314 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1275 microversion: 2.1 time: 0.220843 Aug 04 13:58:49.685433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 192/408] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:49 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:50.004477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0e6b3c03-4bfa-4a19-8ae3-6de6c7f5b258 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:50.005845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0e6b3c03-4bfa-4a19-8ae3-6de6c7f5b258 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:50.015716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e6b3c03-4bfa-4a19-8ae3-6de6c7f5b258 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.016692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e6b3c03-4bfa-4a19-8ae3-6de6c7f5b258 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.017740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e6b3c03-4bfa-4a19-8ae3-6de6c7f5b258 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.018632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e6b3c03-4bfa-4a19-8ae3-6de6c7f5b258 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.140429 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-316b04e6-3318-47e9-9b33-2a5e3547a3b6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:50.142055 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-316b04e6-3318-47e9-9b33-2a5e3547a3b6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:50.154432 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-316b04e6-3318-47e9-9b33-2a5e3547a3b6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.156581 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0e6b3c03-4bfa-4a19-8ae3-6de6c7f5b258 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 19342 microversion: 2.20 time: 0.157318 Aug 04 13:58:50.157735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 217/409] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:49 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 19342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:50.158434 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-316b04e6-3318-47e9-9b33-2a5e3547a3b6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.159711 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-316b04e6-3318-47e9-9b33-2a5e3547a3b6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.160425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-316b04e6-3318-47e9-9b33-2a5e3547a3b6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.487360 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ee285ae3-2951-442e-b942-11a5ecca93ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:50.492539 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ee285ae3-2951-442e-b942-11a5ecca93ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:50.493551 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-316b04e6-3318-47e9-9b33-2a5e3547a3b6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:50.515822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-316b04e6-3318-47e9-9b33-2a5e3547a3b6 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.382306 Aug 04 13:58:50.517044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 193/410] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:50 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:50.521094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee285ae3-2951-442e-b942-11a5ecca93ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.521855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee285ae3-2951-442e-b942-11a5ecca93ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.523070 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee285ae3-2951-442e-b942-11a5ecca93ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.523718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee285ae3-2951-442e-b942-11a5ecca93ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.574745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-73204094-d74c-4e7d-a886-ea54320b3521 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:50.576715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-73204094-d74c-4e7d-a886-ea54320b3521 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:50.587568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73204094-d74c-4e7d-a886-ea54320b3521 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.588564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73204094-d74c-4e7d-a886-ea54320b3521 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.589749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73204094-d74c-4e7d-a886-ea54320b3521 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.591630 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73204094-d74c-4e7d-a886-ea54320b3521 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.791114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-73204094-d74c-4e7d-a886-ea54320b3521 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 23229 microversion: 2.1 time: 0.221915 Aug 04 13:58:50.792783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 194/411] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:50 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 23229 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:58:50.804358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-493ccec0-9c55-4ca8-b740-6cfee4f210d8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:50.806569 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-493ccec0-9c55-4ca8-b740-6cfee4f210d8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:50.819083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-493ccec0-9c55-4ca8-b740-6cfee4f210d8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.820621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-493ccec0-9c55-4ca8-b740-6cfee4f210d8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.822635 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-493ccec0-9c55-4ca8-b740-6cfee4f210d8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:50.823784 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-493ccec0-9c55-4ca8-b740-6cfee4f210d8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:50.910207 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ee285ae3-2951-442e-b942-11a5ecca93ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:50.934597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ee285ae3-2951-442e-b942-11a5ecca93ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.457749 Aug 04 13:58:50.938590 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 218/412] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:50 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:51.096086 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-493ccec0-9c55-4ca8-b740-6cfee4f210d8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:51.117156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-493ccec0-9c55-4ca8-b740-6cfee4f210d8 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.321568 Aug 04 13:58:51.118263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 195/413] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:50 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:51.170915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b3799362-4853-413a-b0ed-5f742d4ed013 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:51.173894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b3799362-4853-413a-b0ed-5f742d4ed013 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:51.184760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b3799362-4853-413a-b0ed-5f742d4ed013 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.185696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b3799362-4853-413a-b0ed-5f742d4ed013 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:51.188564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b3799362-4853-413a-b0ed-5f742d4ed013 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.189862 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b3799362-4853-413a-b0ed-5f742d4ed013 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:51.319513 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b3799362-4853-413a-b0ed-5f742d4ed013 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 22021 microversion: 2.20 time: 0.153563 Aug 04 13:58:51.320483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 219/414] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:51 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 22021 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:58:51.547047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0a6346ab-b6be-4862-80c3-b14690531d42 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:51.548696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0a6346ab-b6be-4862-80c3-b14690531d42 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:51.556677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a6346ab-b6be-4862-80c3-b14690531d42 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.557505 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a6346ab-b6be-4862-80c3-b14690531d42 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:51.558702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a6346ab-b6be-4862-80c3-b14690531d42 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.559384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a6346ab-b6be-4862-80c3-b14690531d42 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:51.647830 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-7f9c2307-40e6-4147-99ec-506fa15937bf req-32af6df8-0369-4e66-8086-9189c4b3bf06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2", "tag": "609e30bc-41d6-4f52-9b43-6b4c4b3d1df3"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:51.649481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:51.649481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:58:51.663572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-7f9c2307-40e6-4147-99ec-506fa15937bf req-32af6df8-0369-4e66-8086-9189c4b3bf06 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.665675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-7f9c2307-40e6-4147-99ec-506fa15937bf req-32af6df8-0369-4e66-8086-9189c4b3bf06 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:51.685780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-7f9c2307-40e6-4147-99ec-506fa15937bf req-32af6df8-0369-4e66-8086-9189c4b3bf06 service nova] Creating event network-changed:609e30bc-41d6-4f52-9b43-6b4c4b3d1df3 for instance a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 on hv-cinder-79264 Aug 04 13:58:51.692006 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-7f9c2307-40e6-4147-99ec-506fa15937bf req-32af6df8-0369-4e66-8086-9189c4b3bf06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048230 Aug 04 13:58:51.693534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 220/415] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:58:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:51.809260 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-07414bf2-dfba-4327-9e56-514fd9a81ddf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:51.810881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-07414bf2-dfba-4327-9e56-514fd9a81ddf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:51.819418 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07414bf2-dfba-4327-9e56-514fd9a81ddf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.820147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07414bf2-dfba-4327-9e56-514fd9a81ddf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:51.822054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07414bf2-dfba-4327-9e56-514fd9a81ddf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.823955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07414bf2-dfba-4327-9e56-514fd9a81ddf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:51.904534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0a6346ab-b6be-4862-80c3-b14690531d42 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:51.924182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0a6346ab-b6be-4862-80c3-b14690531d42 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.381713 Aug 04 13:58:51.945280 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 196/416] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:51 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:51.948719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-07414bf2-dfba-4327-9e56-514fd9a81ddf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 24490 microversion: 2.1 time: 0.145287 Aug 04 13:58:51.949868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 221/417] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:51 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 24490 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:51.975637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-36614492-5f4d-402f-99a6-c469e6f91e07 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:51.977664 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-36614492-5f4d-402f-99a6-c469e6f91e07 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:51.995442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-36614492-5f4d-402f-99a6-c469e6f91e07 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.996448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-36614492-5f4d-402f-99a6-c469e6f91e07 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:51.997929 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-36614492-5f4d-402f-99a6-c469e6f91e07 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:51.999589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-36614492-5f4d-402f-99a6-c469e6f91e07 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:52.149805 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-515756ba-59a2-4c12-a226-c54a33ffbe41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:52.155054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-515756ba-59a2-4c12-a226-c54a33ffbe41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:52.178212 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-515756ba-59a2-4c12-a226-c54a33ffbe41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:52.181741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-515756ba-59a2-4c12-a226-c54a33ffbe41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:52.188421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-515756ba-59a2-4c12-a226-c54a33ffbe41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:52.194515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-515756ba-59a2-4c12-a226-c54a33ffbe41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:52.413137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-36614492-5f4d-402f-99a6-c469e6f91e07 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:52.430716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-36614492-5f4d-402f-99a6-c469e6f91e07 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.465713 Aug 04 13:58:52.434131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 197/418] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:51 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:52.449727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-118e1399-4421-4084-82e3-a43a694adf73 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:52.452812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-118e1399-4421-4084-82e3-a43a694adf73 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:52.468955 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-118e1399-4421-4084-82e3-a43a694adf73 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:52.470922 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-118e1399-4421-4084-82e3-a43a694adf73 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:52.474003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-118e1399-4421-4084-82e3-a43a694adf73 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:52.475869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-118e1399-4421-4084-82e3-a43a694adf73 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:52.651883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-515756ba-59a2-4c12-a226-c54a33ffbe41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:52.689739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-515756ba-59a2-4c12-a226-c54a33ffbe41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.551135 Aug 04 13:58:52.693467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 222/419] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:52 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:52.715905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-118e1399-4421-4084-82e3-a43a694adf73 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 23801 microversion: 2.20 time: 0.278475 Aug 04 13:58:52.716969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 198/420] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:52 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 23801 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:52.963500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7d40d0e0-2da5-4019-a97c-7ce18369a03e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:52.965964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7d40d0e0-2da5-4019-a97c-7ce18369a03e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:52.969355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e71cee75-3087-41b7-b23f-bc0150f15e44 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:52.970375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e71cee75-3087-41b7-b23f-bc0150f15e44 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:52.982600 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d40d0e0-2da5-4019-a97c-7ce18369a03e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:52.984591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d40d0e0-2da5-4019-a97c-7ce18369a03e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:52.986455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d40d0e0-2da5-4019-a97c-7ce18369a03e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:52.987619 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d40d0e0-2da5-4019-a97c-7ce18369a03e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:52.999327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e71cee75-3087-41b7-b23f-bc0150f15e44 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:53.003226 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e71cee75-3087-41b7-b23f-bc0150f15e44 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:53.007817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e71cee75-3087-41b7-b23f-bc0150f15e44 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:53.009916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e71cee75-3087-41b7-b23f-bc0150f15e44 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:53.233123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e71cee75-3087-41b7-b23f-bc0150f15e44 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 25519 microversion: 2.1 time: 0.270516 Aug 04 13:58:53.236646 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 199/421] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:52 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 25519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:53.332707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7d40d0e0-2da5-4019-a97c-7ce18369a03e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:53.350360 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7d40d0e0-2da5-4019-a97c-7ce18369a03e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.399595 Aug 04 13:58:53.364279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 223/422] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:52 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:53.459513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7d464557-a7e0-4d1e-b102-df8b500e0231 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:53.459513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7d464557-a7e0-4d1e-b102-df8b500e0231 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:53.475475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7d464557-a7e0-4d1e-b102-df8b500e0231 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:53.482769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7d464557-a7e0-4d1e-b102-df8b500e0231 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:53.482769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7d464557-a7e0-4d1e-b102-df8b500e0231 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:53.482769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7d464557-a7e0-4d1e-b102-df8b500e0231 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:53.715982 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f21e0496-0255-4e85-a126-9c5a70809470 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:53.718471 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f21e0496-0255-4e85-a126-9c5a70809470 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:53.737799 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f21e0496-0255-4e85-a126-9c5a70809470 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:53.739444 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f21e0496-0255-4e85-a126-9c5a70809470 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:53.740341 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f21e0496-0255-4e85-a126-9c5a70809470 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:53.740777 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f21e0496-0255-4e85-a126-9c5a70809470 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:53.813419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7d464557-a7e0-4d1e-b102-df8b500e0231 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:53.823940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7d464557-a7e0-4d1e-b102-df8b500e0231 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.371161 Aug 04 13:58:53.824604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 200/423] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:53 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:53.832358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e2e8db45-cebd-4993-8d8f-b90619603930 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:53.838794 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e2e8db45-cebd-4993-8d8f-b90619603930 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:53.853324 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e2e8db45-cebd-4993-8d8f-b90619603930 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:53.854174 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e2e8db45-cebd-4993-8d8f-b90619603930 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:53.856943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e2e8db45-cebd-4993-8d8f-b90619603930 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:53.858987 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e2e8db45-cebd-4993-8d8f-b90619603930 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:54.007477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f21e0496-0255-4e85-a126-9c5a70809470 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:54.026906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f21e0496-0255-4e85-a126-9c5a70809470 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.314541 Aug 04 13:58:54.029127 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 224/424] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:53 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:54.058578 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e2e8db45-cebd-4993-8d8f-b90619603930 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 24493 microversion: 2.20 time: 0.231519 Aug 04 13:58:54.067417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 201/425] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:53 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 24493 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:54.261234 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-832befee-0fb2-4eb7-9908-665cf5b0fb6c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:54.267618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-832befee-0fb2-4eb7-9908-665cf5b0fb6c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:54.285529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-832befee-0fb2-4eb7-9908-665cf5b0fb6c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:54.286802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-832befee-0fb2-4eb7-9908-665cf5b0fb6c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:54.290791 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-832befee-0fb2-4eb7-9908-665cf5b0fb6c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:54.294297 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-832befee-0fb2-4eb7-9908-665cf5b0fb6c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:54.385524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ff38d0db-2dcd-4b14-9a0c-042a44fae2e9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:54.388873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ff38d0db-2dcd-4b14-9a0c-042a44fae2e9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:54.399824 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff38d0db-2dcd-4b14-9a0c-042a44fae2e9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:54.400673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff38d0db-2dcd-4b14-9a0c-042a44fae2e9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:54.401849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff38d0db-2dcd-4b14-9a0c-042a44fae2e9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:54.402997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff38d0db-2dcd-4b14-9a0c-042a44fae2e9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:54.476779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-832befee-0fb2-4eb7-9908-665cf5b0fb6c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 26286 microversion: 2.1 time: 0.228368 Aug 04 13:58:54.478456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 225/426] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:54 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 26286 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:54.674085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ff38d0db-2dcd-4b14-9a0c-042a44fae2e9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:54.681994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ff38d0db-2dcd-4b14-9a0c-042a44fae2e9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.306314 Aug 04 13:58:54.682591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 202/427] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:54 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:54.856685 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b9c1809-b2c3-411f-beab-204b0bfed0cc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:54.857531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b9c1809-b2c3-411f-beab-204b0bfed0cc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:54.870357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b9c1809-b2c3-411f-beab-204b0bfed0cc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:54.871483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b9c1809-b2c3-411f-beab-204b0bfed0cc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:54.873869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b9c1809-b2c3-411f-beab-204b0bfed0cc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:54.875316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b9c1809-b2c3-411f-beab-204b0bfed0cc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:55.052342 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1ad6bcc7-41f9-4d4b-8879-4ffb6b21e3c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:55.052342 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1ad6bcc7-41f9-4d4b-8879-4ffb6b21e3c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:55.055785 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1ad6bcc7-41f9-4d4b-8879-4ffb6b21e3c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:55.056417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1ad6bcc7-41f9-4d4b-8879-4ffb6b21e3c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:55.057935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1ad6bcc7-41f9-4d4b-8879-4ffb6b21e3c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:55.058403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1ad6bcc7-41f9-4d4b-8879-4ffb6b21e3c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:55.201084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1b9c1809-b2c3-411f-beab-204b0bfed0cc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:55.214205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b9c1809-b2c3-411f-beab-204b0bfed0cc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.365573 Aug 04 13:58:55.215829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 226/428] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:54 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:55.224261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-874935b2-4b1c-4c96-baa9-ff8a29601fa3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:55.225977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-874935b2-4b1c-4c96-baa9-ff8a29601fa3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:55.237491 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-874935b2-4b1c-4c96-baa9-ff8a29601fa3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:55.238709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-874935b2-4b1c-4c96-baa9-ff8a29601fa3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:55.240337 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-874935b2-4b1c-4c96-baa9-ff8a29601fa3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:55.241249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-874935b2-4b1c-4c96-baa9-ff8a29601fa3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:55.265303 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1ad6bcc7-41f9-4d4b-8879-4ffb6b21e3c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:55.313526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1ad6bcc7-41f9-4d4b-8879-4ffb6b21e3c9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.266115 Aug 04 13:58:55.315259 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 203/429] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:55 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:55.409795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-874935b2-4b1c-4c96-baa9-ff8a29601fa3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 25517 microversion: 2.20 time: 0.189300 Aug 04 13:58:55.412116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 227/430] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:55 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 25517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:55.495119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-eb830018-e313-43b1-ba81-60fb85b91b90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:55.497192 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-eb830018-e313-43b1-ba81-60fb85b91b90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:55.509110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eb830018-e313-43b1-ba81-60fb85b91b90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:55.510135 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eb830018-e313-43b1-ba81-60fb85b91b90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:55.511770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eb830018-e313-43b1-ba81-60fb85b91b90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:55.512882 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eb830018-e313-43b1-ba81-60fb85b91b90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:55.685642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-eb830018-e313-43b1-ba81-60fb85b91b90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 26865 microversion: 2.1 time: 0.197691 Aug 04 13:58:55.687836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 204/431] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:55 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 26865 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:55.707041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9d26dccf-5004-4c52-8167-36d88f254e1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:55.709503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9d26dccf-5004-4c52-8167-36d88f254e1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:55.721117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d26dccf-5004-4c52-8167-36d88f254e1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:55.721924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d26dccf-5004-4c52-8167-36d88f254e1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:55.724024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d26dccf-5004-4c52-8167-36d88f254e1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:55.725214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d26dccf-5004-4c52-8167-36d88f254e1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.067476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9d26dccf-5004-4c52-8167-36d88f254e1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:56.082027 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9d26dccf-5004-4c52-8167-36d88f254e1e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.383392 Aug 04 13:58:56.083800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 228/432] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:55 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:56.239639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3d5f408d-1c02-4f0a-b195-23559bc15427 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:56.247263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3d5f408d-1c02-4f0a-b195-23559bc15427 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:56.271123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d5f408d-1c02-4f0a-b195-23559bc15427 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:56.272708 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d5f408d-1c02-4f0a-b195-23559bc15427 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.274397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d5f408d-1c02-4f0a-b195-23559bc15427 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:56.275454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d5f408d-1c02-4f0a-b195-23559bc15427 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.351367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2de0a2e4-596d-4e60-ad96-df5ebf946327 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:56.352421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2de0a2e4-596d-4e60-ad96-df5ebf946327 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:56.370462 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2de0a2e4-596d-4e60-ad96-df5ebf946327 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:56.370462 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2de0a2e4-596d-4e60-ad96-df5ebf946327 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.372763 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2de0a2e4-596d-4e60-ad96-df5ebf946327 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:56.372763 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2de0a2e4-596d-4e60-ad96-df5ebf946327 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.775654 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3d5f408d-1c02-4f0a-b195-23559bc15427 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:56.790816 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3d5f408d-1c02-4f0a-b195-23559bc15427 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.559401 Aug 04 13:58:56.791938 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 205/433] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:56 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:56.801885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0fc65caf-679f-4cd2-91cb-f2d612b73584 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:56.803649 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0fc65caf-679f-4cd2-91cb-f2d612b73584 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:56.818374 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0fc65caf-679f-4cd2-91cb-f2d612b73584 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:56.819095 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0fc65caf-679f-4cd2-91cb-f2d612b73584 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.824383 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0fc65caf-679f-4cd2-91cb-f2d612b73584 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:56.825240 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0fc65caf-679f-4cd2-91cb-f2d612b73584 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.848380 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2de0a2e4-596d-4e60-ad96-df5ebf946327 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:56.868464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2de0a2e4-596d-4e60-ad96-df5ebf946327 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.525268 Aug 04 13:58:56.877547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 229/434] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:56 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:56.895314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-97f68a38-81e2-4add-8800-88bc30dc71b6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:56.902664 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-97f68a38-81e2-4add-8800-88bc30dc71b6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:56.914482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97f68a38-81e2-4add-8800-88bc30dc71b6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:56.915515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97f68a38-81e2-4add-8800-88bc30dc71b6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.917616 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97f68a38-81e2-4add-8800-88bc30dc71b6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:56.918527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97f68a38-81e2-4add-8800-88bc30dc71b6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:56.988952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0fc65caf-679f-4cd2-91cb-f2d612b73584 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 26753 microversion: 2.20 time: 0.195215 Aug 04 13:58:56.989660 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 206/435] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:56 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 26753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:57.062586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-97f68a38-81e2-4add-8800-88bc30dc71b6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 27605 microversion: 2.1 time: 0.182379 Aug 04 13:58:57.064152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 230/436] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:56 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 27605 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:57.114813 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d07a7b36-022f-44e6-addf-397e7764f2f8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:57.115605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d07a7b36-022f-44e6-addf-397e7764f2f8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:57.128625 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d07a7b36-022f-44e6-addf-397e7764f2f8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:57.129046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d07a7b36-022f-44e6-addf-397e7764f2f8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:57.130898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d07a7b36-022f-44e6-addf-397e7764f2f8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:57.132688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d07a7b36-022f-44e6-addf-397e7764f2f8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:57.476064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d07a7b36-022f-44e6-addf-397e7764f2f8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:57.490790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d07a7b36-022f-44e6-addf-397e7764f2f8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.380630 Aug 04 13:58:57.497932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 207/437] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:57 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:57.817550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e1f2a174-5f98-4dd8-915f-735988c7f818 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:57.819713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e1f2a174-5f98-4dd8-915f-735988c7f818 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:57.840095 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1f2a174-5f98-4dd8-915f-735988c7f818 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:57.841335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1f2a174-5f98-4dd8-915f-735988c7f818 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:57.844587 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1f2a174-5f98-4dd8-915f-735988c7f818 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:57.845827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1f2a174-5f98-4dd8-915f-735988c7f818 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:57.907435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f85b11d9-3524-4746-b5a5-4cca8954d661 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:57.911156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f85b11d9-3524-4746-b5a5-4cca8954d661 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:57.935547 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f85b11d9-3524-4746-b5a5-4cca8954d661 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:57.937026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f85b11d9-3524-4746-b5a5-4cca8954d661 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:57.942893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f85b11d9-3524-4746-b5a5-4cca8954d661 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:57.946072 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f85b11d9-3524-4746-b5a5-4cca8954d661 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:58.175432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e1f2a174-5f98-4dd8-915f-735988c7f818 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:58.195284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e1f2a174-5f98-4dd8-915f-735988c7f818 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.379133 Aug 04 13:58:58.196984 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 231/438] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:57 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:58.212795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-14a9ccae-0fd7-443c-aee0-e88f56797a61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:58.214395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-14a9ccae-0fd7-443c-aee0-e88f56797a61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:58.240666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-14a9ccae-0fd7-443c-aee0-e88f56797a61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:58.241397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-14a9ccae-0fd7-443c-aee0-e88f56797a61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:58.242751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-14a9ccae-0fd7-443c-aee0-e88f56797a61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:58.243472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-14a9ccae-0fd7-443c-aee0-e88f56797a61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:58.427055 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-14a9ccae-0fd7-443c-aee0-e88f56797a61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 27541 microversion: 2.20 time: 0.228518 Aug 04 13:58:58.431348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 232/439] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:58 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 27541 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:58.453129 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-67699f7e-83fc-4b95-8c92-f51ce89bff1d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:58.455581 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-67699f7e-83fc-4b95-8c92-f51ce89bff1d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:58.483520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67699f7e-83fc-4b95-8c92-f51ce89bff1d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:58.490451 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67699f7e-83fc-4b95-8c92-f51ce89bff1d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:58.495259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67699f7e-83fc-4b95-8c92-f51ce89bff1d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:58.496048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67699f7e-83fc-4b95-8c92-f51ce89bff1d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:58.577307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f85b11d9-3524-4746-b5a5-4cca8954d661 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:58.594486 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f85b11d9-3524-4746-b5a5-4cca8954d661 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.699510 Aug 04 13:58:58.602895 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 208/440] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:57 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:58.612185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6980102b-72fa-4df2-907e-c199949451cd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:58.614635 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6980102b-72fa-4df2-907e-c199949451cd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:58.629240 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6980102b-72fa-4df2-907e-c199949451cd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:58.630041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6980102b-72fa-4df2-907e-c199949451cd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:58.636016 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6980102b-72fa-4df2-907e-c199949451cd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:58.638166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6980102b-72fa-4df2-907e-c199949451cd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:58.690517 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-67699f7e-83fc-4b95-8c92-f51ce89bff1d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 27968 microversion: 2.1 time: 0.260329 Aug 04 13:58:58.691410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 233/441] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:58 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 27968 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:58.940127 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6980102b-72fa-4df2-907e-c199949451cd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:58.950257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6980102b-72fa-4df2-907e-c199949451cd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.345694 Aug 04 13:58:58.961940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 209/442] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:58 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:59.220628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cebe6c71-2721-4bbf-82b0-84313458d0af tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:59.222028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cebe6c71-2721-4bbf-82b0-84313458d0af tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:59.231378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cebe6c71-2721-4bbf-82b0-84313458d0af tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.231814 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cebe6c71-2721-4bbf-82b0-84313458d0af tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.233607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cebe6c71-2721-4bbf-82b0-84313458d0af tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.233772 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cebe6c71-2721-4bbf-82b0-84313458d0af tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.441714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-573c0475-0a1a-4bb1-b2bf-510ef9947b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:59.443352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-573c0475-0a1a-4bb1-b2bf-510ef9947b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:59.448422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cebe6c71-2721-4bbf-82b0-84313458d0af tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:59.455287 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-573c0475-0a1a-4bb1-b2bf-510ef9947b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.455838 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-573c0475-0a1a-4bb1-b2bf-510ef9947b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.456829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-573c0475-0a1a-4bb1-b2bf-510ef9947b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.457187 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-573c0475-0a1a-4bb1-b2bf-510ef9947b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.458677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cebe6c71-2721-4bbf-82b0-84313458d0af tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.244852 Aug 04 13:58:59.467966 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 234/443] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:59 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:59.587732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-573c0475-0a1a-4bb1-b2bf-510ef9947b99 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 27726 microversion: 2.20 time: 0.151426 Aug 04 13:58:59.589001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 210/444] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:58:59 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 27726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:58:59.626980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fb4ff610-710c-4a7c-b015-65c6336a5f7d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:59.628056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fb4ff610-710c-4a7c-b015-65c6336a5f7d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:59.638227 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb4ff610-710c-4a7c-b015-65c6336a5f7d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.638750 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb4ff610-710c-4a7c-b015-65c6336a5f7d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.640831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb4ff610-710c-4a7c-b015-65c6336a5f7d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.641553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb4ff610-710c-4a7c-b015-65c6336a5f7d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.705367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1c6817ce-7411-4aa5-93e8-39e8fb21da26 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:59.706450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1c6817ce-7411-4aa5-93e8-39e8fb21da26 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:59.713889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c6817ce-7411-4aa5-93e8-39e8fb21da26 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.714560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c6817ce-7411-4aa5-93e8-39e8fb21da26 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.715391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c6817ce-7411-4aa5-93e8-39e8fb21da26 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.715946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c6817ce-7411-4aa5-93e8-39e8fb21da26 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.797251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fb4ff610-710c-4a7c-b015-65c6336a5f7d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:59.806041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fb4ff610-710c-4a7c-b015-65c6336a5f7d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.184967 Aug 04 13:58:59.806755 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 235/445] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:59 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:59.836164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1c6817ce-7411-4aa5-93e8-39e8fb21da26 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.135755 Aug 04 13:58:59.836902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 211/446] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:58:59 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:59.973987 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6d66b928-a38f-4cd9-87b5-f54b7d09d8d8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:59.974953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6d66b928-a38f-4cd9-87b5-f54b7d09d8d8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:58:59.984462 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d66b928-a38f-4cd9-87b5-f54b7d09d8d8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.985222 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d66b928-a38f-4cd9-87b5-f54b7d09d8d8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:58:59.986539 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d66b928-a38f-4cd9-87b5-f54b7d09d8d8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:58:59.987277 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d66b928-a38f-4cd9-87b5-f54b7d09d8d8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:00.205039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6d66b928-a38f-4cd9-87b5-f54b7d09d8d8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:00.222757 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6d66b928-a38f-4cd9-87b5-f54b7d09d8d8 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.254643 Aug 04 13:59:00.234226 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 236/447] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:58:59 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:00.485215 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5aa711bb-ccea-455d-a7cb-df8cfb305412 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:00.486888 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5aa711bb-ccea-455d-a7cb-df8cfb305412 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:00.511129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5aa711bb-ccea-455d-a7cb-df8cfb305412 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:00.511905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5aa711bb-ccea-455d-a7cb-df8cfb305412 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:00.515975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5aa711bb-ccea-455d-a7cb-df8cfb305412 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:00.517153 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5aa711bb-ccea-455d-a7cb-df8cfb305412 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:00.558905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-51781069-22cb-4c96-9d41-82bb26e1e670 req-9e1c28f8-cee1-45a9-ad37-ac20131ad8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f674980e-9f84-4659-bbd4-114786775944", "name": "network-vif-plugged", "status": "completed", "tag": "2291b3bf-fa3c-4988-994b-0bdcb2e3ed75"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:00.564769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:59:00.564769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:59:00.597858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-51781069-22cb-4c96-9d41-82bb26e1e670 req-9e1c28f8-cee1-45a9-ad37-ac20131ad8e4 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:00.598773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-51781069-22cb-4c96-9d41-82bb26e1e670 req-9e1c28f8-cee1-45a9-ad37-ac20131ad8e4 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:00.662899 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-51781069-22cb-4c96-9d41-82bb26e1e670 req-9e1c28f8-cee1-45a9-ad37-ac20131ad8e4 service nova] Creating event network-vif-plugged:2291b3bf-fa3c-4988-994b-0bdcb2e3ed75 for instance f674980e-9f84-4659-bbd4-114786775944 on hv-cinder-79264 Aug 04 13:59:00.683190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-51781069-22cb-4c96-9d41-82bb26e1e670 req-9e1c28f8-cee1-45a9-ad37-ac20131ad8e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132087 Aug 04 13:59:00.688180 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 237/448] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:59:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:59:00.706050 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-79fd6d28-070e-442f-9ba3-ab60bcfd511c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:00.711956 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-79fd6d28-070e-442f-9ba3-ab60bcfd511c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:00.771419 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-79fd6d28-070e-442f-9ba3-ab60bcfd511c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:00.772748 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-79fd6d28-070e-442f-9ba3-ab60bcfd511c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:00.774500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-79fd6d28-070e-442f-9ba3-ab60bcfd511c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:00.781765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-79fd6d28-070e-442f-9ba3-ab60bcfd511c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:00.980686 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-79fd6d28-070e-442f-9ba3-ab60bcfd511c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28030 microversion: 2.20 time: 0.287259 Aug 04 13:59:00.985838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 238/449] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:00 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28030 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:00.991446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5aa711bb-ccea-455d-a7cb-df8cfb305412 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:01.005888 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-02aa9766-f63a-41bd-943b-844edc3457e0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:01.007877 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-02aa9766-f63a-41bd-943b-844edc3457e0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:01.008810 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5aa711bb-ccea-455d-a7cb-df8cfb305412 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.534311 Aug 04 13:59:01.009998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 212/450] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:00 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:01.021254 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-02aa9766-f63a-41bd-943b-844edc3457e0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:01.023991 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-02aa9766-f63a-41bd-943b-844edc3457e0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:01.027299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-02aa9766-f63a-41bd-943b-844edc3457e0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:01.027769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-047cd0c3-3078-4aef-aaa7-7a92a216b051 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:01.029013 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-02aa9766-f63a-41bd-943b-844edc3457e0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:01.030790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-047cd0c3-3078-4aef-aaa7-7a92a216b051 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:01.042729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-047cd0c3-3078-4aef-aaa7-7a92a216b051 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:01.044022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-047cd0c3-3078-4aef-aaa7-7a92a216b051 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:01.046162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-047cd0c3-3078-4aef-aaa7-7a92a216b051 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:01.047466 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-047cd0c3-3078-4aef-aaa7-7a92a216b051 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:01.188897 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-047cd0c3-3078-4aef-aaa7-7a92a216b051 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.175321 Aug 04 13:59:01.189513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 213/451] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:01 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:01.241997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-720c3248-ebf5-4ddf-baec-c39c275d726c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:01.242719 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-720c3248-ebf5-4ddf-baec-c39c275d726c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:01.250624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-720c3248-ebf5-4ddf-baec-c39c275d726c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:01.251207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-720c3248-ebf5-4ddf-baec-c39c275d726c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:01.258221 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-720c3248-ebf5-4ddf-baec-c39c275d726c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:01.258802 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-720c3248-ebf5-4ddf-baec-c39c275d726c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:01.312020 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-02aa9766-f63a-41bd-943b-844edc3457e0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:01.321846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-02aa9766-f63a-41bd-943b-844edc3457e0 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.333032 Aug 04 13:59:01.322943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 239/452] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:00 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:01.419641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-720c3248-ebf5-4ddf-baec-c39c275d726c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:01.429368 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-720c3248-ebf5-4ddf-baec-c39c275d726c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.191863 Aug 04 13:59:01.429956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 214/453] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:01 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:02.001180 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5e9da6de-381b-4422-9f76-036588e0da86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:02.002660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5e9da6de-381b-4422-9f76-036588e0da86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:02.010589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5e9da6de-381b-4422-9f76-036588e0da86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.010915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5e9da6de-381b-4422-9f76-036588e0da86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.011709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5e9da6de-381b-4422-9f76-036588e0da86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.012136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5e9da6de-381b-4422-9f76-036588e0da86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.035352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-15a494e5-8d2f-4307-ac2d-a8bb789b49db tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:02.036173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-15a494e5-8d2f-4307-ac2d-a8bb789b49db tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:02.056147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15a494e5-8d2f-4307-ac2d-a8bb789b49db tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.059135 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15a494e5-8d2f-4307-ac2d-a8bb789b49db tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.061720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15a494e5-8d2f-4307-ac2d-a8bb789b49db tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.062632 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15a494e5-8d2f-4307-ac2d-a8bb789b49db tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.178898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5e9da6de-381b-4422-9f76-036588e0da86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28097 microversion: 2.20 time: 0.183279 Aug 04 13:59:02.179769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 240/454] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:01 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28097 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:02.214676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-05befefe-8ea5-4ac5-a727-ef2cbfb9ca91 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:02.215797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-05befefe-8ea5-4ac5-a727-ef2cbfb9ca91 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:02.230302 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-05befefe-8ea5-4ac5-a727-ef2cbfb9ca91 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.231226 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-05befefe-8ea5-4ac5-a727-ef2cbfb9ca91 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.234740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-05befefe-8ea5-4ac5-a727-ef2cbfb9ca91 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.235937 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-05befefe-8ea5-4ac5-a727-ef2cbfb9ca91 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.277977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-15a494e5-8d2f-4307-ac2d-a8bb789b49db tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:02.289763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-15a494e5-8d2f-4307-ac2d-a8bb789b49db tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1266 microversion: 2.1 time: 0.258151 Aug 04 13:59:02.290459 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 215/455] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:02 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:02.353157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-17b94a82-fa72-4812-a2d1-4b850bc0ab6a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:02.355033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-17b94a82-fa72-4812-a2d1-4b850bc0ab6a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:02.365235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17b94a82-fa72-4812-a2d1-4b850bc0ab6a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.365839 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17b94a82-fa72-4812-a2d1-4b850bc0ab6a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.366741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17b94a82-fa72-4812-a2d1-4b850bc0ab6a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.367326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-17b94a82-fa72-4812-a2d1-4b850bc0ab6a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.391841 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-05befefe-8ea5-4ac5-a727-ef2cbfb9ca91 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.184395 Aug 04 13:59:02.396346 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 241/456] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:02 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:02.471036 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d0566693-11d2-4844-b920-69551abb6d3a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:02.472537 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d0566693-11d2-4844-b920-69551abb6d3a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:02.486221 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0566693-11d2-4844-b920-69551abb6d3a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.487251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0566693-11d2-4844-b920-69551abb6d3a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.488822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0566693-11d2-4844-b920-69551abb6d3a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.489475 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0566693-11d2-4844-b920-69551abb6d3a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.612104 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-17b94a82-fa72-4812-a2d1-4b850bc0ab6a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:02.631741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-17b94a82-fa72-4812-a2d1-4b850bc0ab6a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.285445 Aug 04 13:59:02.645141 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 216/457] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:02 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:02.764552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d0566693-11d2-4844-b920-69551abb6d3a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:02.780038 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d0566693-11d2-4844-b920-69551abb6d3a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.323389 Aug 04 13:59:02.780979 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 242/458] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:02 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:02.821839 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-7765e29d-04d6-42ee-a02f-db0dfea31c50 req-65c83a3a-bc32-4e94-934c-b1faf79e6f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2", "name": "network-vif-plugged", "status": "completed", "tag": "609e30bc-41d6-4f52-9b43-6b4c4b3d1df3"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:02.823991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:59:02.823991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:59:02.833011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7765e29d-04d6-42ee-a02f-db0dfea31c50 req-65c83a3a-bc32-4e94-934c-b1faf79e6f0d service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:02.833454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7765e29d-04d6-42ee-a02f-db0dfea31c50 req-65c83a3a-bc32-4e94-934c-b1faf79e6f0d service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:02.845908 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-7765e29d-04d6-42ee-a02f-db0dfea31c50 req-65c83a3a-bc32-4e94-934c-b1faf79e6f0d service nova] Creating event network-vif-plugged:609e30bc-41d6-4f52-9b43-6b4c4b3d1df3 for instance a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 on hv-cinder-79264 Aug 04 13:59:02.851576 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-7765e29d-04d6-42ee-a02f-db0dfea31c50 req-65c83a3a-bc32-4e94-934c-b1faf79e6f0d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033848 Aug 04 13:59:02.852257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 217/459] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:59:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:03.196206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0acd181c-8acd-46e9-abd7-f97dfb3f2415 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:03.198230 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0acd181c-8acd-46e9-abd7-f97dfb3f2415 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:03.209692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0acd181c-8acd-46e9-abd7-f97dfb3f2415 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.210486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0acd181c-8acd-46e9-abd7-f97dfb3f2415 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.213524 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0acd181c-8acd-46e9-abd7-f97dfb3f2415 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.214689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0acd181c-8acd-46e9-abd7-f97dfb3f2415 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.313883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0edd9d40-8044-4a9f-a614-8c1b25dec720 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:03.314659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0edd9d40-8044-4a9f-a614-8c1b25dec720 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:03.323239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0edd9d40-8044-4a9f-a614-8c1b25dec720 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.324075 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0edd9d40-8044-4a9f-a614-8c1b25dec720 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.325026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0edd9d40-8044-4a9f-a614-8c1b25dec720 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.325520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0edd9d40-8044-4a9f-a614-8c1b25dec720 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.519396 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0edd9d40-8044-4a9f-a614-8c1b25dec720 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:03.527795 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0edd9d40-8044-4a9f-a614-8c1b25dec720 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1453 microversion: 2.1 time: 0.218510 Aug 04 13:59:03.528750 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 218/460] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:03 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1453 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:03.534110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-05fa5cd4-ee29-42c4-b173-f7b0cfb97a90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:03.535071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-05fa5cd4-ee29-42c4-b173-f7b0cfb97a90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:03.541673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05fa5cd4-ee29-42c4-b173-f7b0cfb97a90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.542420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05fa5cd4-ee29-42c4-b173-f7b0cfb97a90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.543396 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05fa5cd4-ee29-42c4-b173-f7b0cfb97a90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.543990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05fa5cd4-ee29-42c4-b173-f7b0cfb97a90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.842615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-05fa5cd4-ee29-42c4-b173-f7b0cfb97a90 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.312040 Aug 04 13:59:03.843618 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 219/461] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:03 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:03.853892 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bb50cd16-f9de-4119-9399-83103dccf862 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:03.855159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bb50cd16-f9de-4119-9399-83103dccf862 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:03.867066 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bb50cd16-f9de-4119-9399-83103dccf862 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.868271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bb50cd16-f9de-4119-9399-83103dccf862 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.868492 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0acd181c-8acd-46e9-abd7-f97dfb3f2415 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.679411 Aug 04 13:59:03.871056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bb50cd16-f9de-4119-9399-83103dccf862 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.871989 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bb50cd16-f9de-4119-9399-83103dccf862 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.873281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 243/462] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:03 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:03.879521 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a74d52b2-59fe-40d6-8a80-178b510d1d84 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:03.883677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a74d52b2-59fe-40d6-8a80-178b510d1d84 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:03.890924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a74d52b2-59fe-40d6-8a80-178b510d1d84 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.891626 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a74d52b2-59fe-40d6-8a80-178b510d1d84 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:03.892624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a74d52b2-59fe-40d6-8a80-178b510d1d84 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:03.893483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a74d52b2-59fe-40d6-8a80-178b510d1d84 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:04.112611 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a74d52b2-59fe-40d6-8a80-178b510d1d84 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:04.127495 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a74d52b2-59fe-40d6-8a80-178b510d1d84 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.252050 Aug 04 13:59:04.129143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 244/463] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:03 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:04.137588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bb50cd16-f9de-4119-9399-83103dccf862 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:04.142187 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-70f9d600-3455-44ef-b358-41cc33bda17b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:04.145272 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-70f9d600-3455-44ef-b358-41cc33bda17b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:04.149125 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bb50cd16-f9de-4119-9399-83103dccf862 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1453 microversion: 2.1 time: 0.303412 Aug 04 13:59:04.160284 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 220/464] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:03 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1453 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:04.160826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-70f9d600-3455-44ef-b358-41cc33bda17b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:04.160826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-70f9d600-3455-44ef-b358-41cc33bda17b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:04.160826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-70f9d600-3455-44ef-b358-41cc33bda17b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:04.160826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-70f9d600-3455-44ef-b358-41cc33bda17b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:04.379568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-70f9d600-3455-44ef-b358-41cc33bda17b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:04.401650 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-70f9d600-3455-44ef-b358-41cc33bda17b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.263108 Aug 04 13:59:04.413378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 245/465] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:04 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:04.862515 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4d7b056b-810c-49f3-917b-f45e1a61abbd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:04.864579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4d7b056b-810c-49f3-917b-f45e1a61abbd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:04.872252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d7b056b-810c-49f3-917b-f45e1a61abbd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:04.873017 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d7b056b-810c-49f3-917b-f45e1a61abbd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:04.877474 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d7b056b-810c-49f3-917b-f45e1a61abbd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:04.878153 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d7b056b-810c-49f3-917b-f45e1a61abbd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:04.890897 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8a3ba28b-7819-45a7-8514-e38f19c7a3d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:04.894807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8a3ba28b-7819-45a7-8514-e38f19c7a3d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:04.918598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a3ba28b-7819-45a7-8514-e38f19c7a3d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:04.919659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a3ba28b-7819-45a7-8514-e38f19c7a3d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:04.923522 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a3ba28b-7819-45a7-8514-e38f19c7a3d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:04.925408 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a3ba28b-7819-45a7-8514-e38f19c7a3d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:05.079621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4d7b056b-810c-49f3-917b-f45e1a61abbd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.227187 Aug 04 13:59:05.081209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 221/466] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:04 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:05.156978 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-209fa6fa-5013-420f-8fba-55b51b0291d7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:05.157706 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-209fa6fa-5013-420f-8fba-55b51b0291d7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:05.171933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8a3ba28b-7819-45a7-8514-e38f19c7a3d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.292658 Aug 04 13:59:05.178114 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 246/467] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:04 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:05.178390 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-209fa6fa-5013-420f-8fba-55b51b0291d7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:05.178390 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-209fa6fa-5013-420f-8fba-55b51b0291d7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:05.178390 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-209fa6fa-5013-420f-8fba-55b51b0291d7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:05.178390 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-209fa6fa-5013-420f-8fba-55b51b0291d7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:05.426576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9d54133d-b4fc-4f56-bfe8-277ae1c63914 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:05.428469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9d54133d-b4fc-4f56-bfe8-277ae1c63914 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:05.442367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d54133d-b4fc-4f56-bfe8-277ae1c63914 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:05.443817 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d54133d-b4fc-4f56-bfe8-277ae1c63914 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:05.445597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d54133d-b4fc-4f56-bfe8-277ae1c63914 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:05.447289 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d54133d-b4fc-4f56-bfe8-277ae1c63914 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:05.452439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-209fa6fa-5013-420f-8fba-55b51b0291d7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:05.465730 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-209fa6fa-5013-420f-8fba-55b51b0291d7 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1317 microversion: 2.1 time: 0.313905 Aug 04 13:59:05.466334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 222/468] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:05 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:05.952024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9d54133d-b4fc-4f56-bfe8-277ae1c63914 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:05.975865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9d54133d-b4fc-4f56-bfe8-277ae1c63914 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.558055 Aug 04 13:59:05.982134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 247/469] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:05 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:06.099149 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-143c88d9-3418-447c-9b47-ce80958dfe45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:06.101963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-143c88d9-3418-447c-9b47-ce80958dfe45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:06.116530 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-143c88d9-3418-447c-9b47-ce80958dfe45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:06.117383 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-143c88d9-3418-447c-9b47-ce80958dfe45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:06.119266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-143c88d9-3418-447c-9b47-ce80958dfe45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:06.120128 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-143c88d9-3418-447c-9b47-ce80958dfe45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:06.192920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-901187dd-70ca-46c3-a19b-ed6f9fb88471 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:06.194856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-901187dd-70ca-46c3-a19b-ed6f9fb88471 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:06.206803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-901187dd-70ca-46c3-a19b-ed6f9fb88471 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:06.208070 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-901187dd-70ca-46c3-a19b-ed6f9fb88471 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:06.209916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-901187dd-70ca-46c3-a19b-ed6f9fb88471 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:06.211411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-901187dd-70ca-46c3-a19b-ed6f9fb88471 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:06.500885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-143c88d9-3418-447c-9b47-ce80958dfe45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.410596 Aug 04 13:59:06.501959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 223/470] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:06 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:06.508204 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-242d3cbf-2084-400a-8d5e-014f14eb2cc5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:06.509638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-242d3cbf-2084-400a-8d5e-014f14eb2cc5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:06.519152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-242d3cbf-2084-400a-8d5e-014f14eb2cc5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:06.520106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-242d3cbf-2084-400a-8d5e-014f14eb2cc5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:06.521261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-242d3cbf-2084-400a-8d5e-014f14eb2cc5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:06.521890 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-242d3cbf-2084-400a-8d5e-014f14eb2cc5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:06.563312 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-901187dd-70ca-46c3-a19b-ed6f9fb88471 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.379783 Aug 04 13:59:06.565080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 248/471] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:06 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:06.769943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-242d3cbf-2084-400a-8d5e-014f14eb2cc5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:06.778167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-242d3cbf-2084-400a-8d5e-014f14eb2cc5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1507 microversion: 2.1 time: 0.274710 Aug 04 13:59:06.779156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 224/472] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:06 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:06.802727 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83a034d9-b9c7-4afa-8194-37bea08bcf3d"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:06.803857 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:06.811170 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:06.812535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:06.813385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:06.813753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:06.956886 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] HTTP exception thrown: Invalid volume: volume 83a034d9-b9c7-4afa-8194-37bea08bcf3d is already attached to instances: 5393f6f8-d997-4def-9ada-9df175d346be Aug 04 13:59:06.957557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Returning 400 to user: Invalid volume: volume 83a034d9-b9c7-4afa-8194-37bea08bcf3d is already attached to instances: 5393f6f8-d997-4def-9ada-9df175d346be {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:59:06.958415 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-75d786c6-f00b-4c3f-8bb6-e192427bfd47 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.159940 Aug 04 13:59:06.959362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 249/473] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 13:59:06 2021] POST /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2/os-volume_attachments => generated 174 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:59:07.004688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f8993573-c654-4a23-bb5f-5cb82547fccd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:07.005402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f8993573-c654-4a23-bb5f-5cb82547fccd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:07.015375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8993573-c654-4a23-bb5f-5cb82547fccd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.016126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8993573-c654-4a23-bb5f-5cb82547fccd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.017515 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8993573-c654-4a23-bb5f-5cb82547fccd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.018222 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8993573-c654-4a23-bb5f-5cb82547fccd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.060258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0e0939e6-a550-4679-b707-e2b359b39f8b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:07.062074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0e0939e6-a550-4679-b707-e2b359b39f8b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:07.076076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e0939e6-a550-4679-b707-e2b359b39f8b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.077669 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e0939e6-a550-4679-b707-e2b359b39f8b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.079765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e0939e6-a550-4679-b707-e2b359b39f8b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.080805 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e0939e6-a550-4679-b707-e2b359b39f8b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.267778 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f8993573-c654-4a23-bb5f-5cb82547fccd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:07.281331 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f8993573-c654-4a23-bb5f-5cb82547fccd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1522 microversion: 2.1 time: 0.283525 Aug 04 13:59:07.291432 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 225/474] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:06 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:07.523885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b81765cf-1b73-4835-a7d3-164405235cb6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:07.529071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b81765cf-1b73-4835-a7d3-164405235cb6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:07.538647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b81765cf-1b73-4835-a7d3-164405235cb6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.539436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b81765cf-1b73-4835-a7d3-164405235cb6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.541479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b81765cf-1b73-4835-a7d3-164405235cb6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.542162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b81765cf-1b73-4835-a7d3-164405235cb6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.695169 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b81765cf-1b73-4835-a7d3-164405235cb6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.183248 Aug 04 13:59:07.695397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-0e0939e6-a550-4679-b707-e2b359b39f8b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lazy-loading 'services' on Instance uuid 5393f6f8-d997-4def-9ada-9df175d346be {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:59:07.696269 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 226/475] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:07 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:59:07.705935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9ac1b9db-20bc-415b-99f9-a73e5d240b1e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:07.707000 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9ac1b9db-20bc-415b-99f9-a73e5d240b1e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:07.713878 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ac1b9db-20bc-415b-99f9-a73e5d240b1e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.714324 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ac1b9db-20bc-415b-99f9-a73e5d240b1e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.715119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ac1b9db-20bc-415b-99f9-a73e5d240b1e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.715556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ac1b9db-20bc-415b-99f9-a73e5d240b1e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.822922 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9ac1b9db-20bc-415b-99f9-a73e5d240b1e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.123476 Aug 04 13:59:07.824623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 227/476] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:07 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:07.849279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-a6630fd1-7aed-46d4-8abb-6f277eaba526 req-e05d3045-866f-466d-abfa-1e651d1e59ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f674980e-9f84-4659-bbd4-114786775944", "tag": "2291b3bf-fa3c-4988-994b-0bdcb2e3ed75"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:07.851009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:59:07.851009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:59:07.862312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-a6630fd1-7aed-46d4-8abb-6f277eaba526 req-e05d3045-866f-466d-abfa-1e651d1e59ee service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:07.863272 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-a6630fd1-7aed-46d4-8abb-6f277eaba526 req-e05d3045-866f-466d-abfa-1e651d1e59ee service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:07.874284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0e0939e6-a550-4679-b707-e2b359b39f8b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be/os-volume_attachments/83a034d9-b9c7-4afa-8194-37bea08bcf3d" status: 202 len: 0 microversion: 2.1 time: 0.829225 Aug 04 13:59:07.875533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 250/477] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 13:59:07 2021] DELETE /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be/os-volume_attachments/83a034d9-b9c7-4afa-8194-37bea08bcf3d => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:07.879588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-a6630fd1-7aed-46d4-8abb-6f277eaba526 req-e05d3045-866f-466d-abfa-1e651d1e59ee service nova] Creating event network-changed:2291b3bf-fa3c-4988-994b-0bdcb2e3ed75 for instance f674980e-9f84-4659-bbd4-114786775944 on hv-cinder-79264 Aug 04 13:59:07.889249 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-a6630fd1-7aed-46d4-8abb-6f277eaba526 req-e05d3045-866f-466d-abfa-1e651d1e59ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060499 Aug 04 13:59:07.890304 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 228/478] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:59:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:08.301222 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-efd4845f-7278-4417-8dcc-fea8c5d9bb22 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:08.302033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-efd4845f-7278-4417-8dcc-fea8c5d9bb22 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:08.313423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efd4845f-7278-4417-8dcc-fea8c5d9bb22 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:08.314260 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efd4845f-7278-4417-8dcc-fea8c5d9bb22 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:08.315476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efd4845f-7278-4417-8dcc-fea8c5d9bb22 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:08.316133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efd4845f-7278-4417-8dcc-fea8c5d9bb22 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:08.708911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-99d248ae-1b07-40ef-a62d-344ae66d9fba tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:08.710372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-99d248ae-1b07-40ef-a62d-344ae66d9fba tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:08.730756 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99d248ae-1b07-40ef-a62d-344ae66d9fba tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:08.731425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99d248ae-1b07-40ef-a62d-344ae66d9fba tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:08.732294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99d248ae-1b07-40ef-a62d-344ae66d9fba tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:08.732872 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99d248ae-1b07-40ef-a62d-344ae66d9fba tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:08.823240 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-efd4845f-7278-4417-8dcc-fea8c5d9bb22 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:08.833983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-efd4845f-7278-4417-8dcc-fea8c5d9bb22 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1502 microversion: 2.1 time: 0.537374 Aug 04 13:59:08.843893 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 251/479] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:08 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1502 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:08.849472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c0a6e76a-32de-4a6c-85ac-992098932b1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:08.850737 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c0a6e76a-32de-4a6c-85ac-992098932b1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:08.870786 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0a6e76a-32de-4a6c-85ac-992098932b1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:08.871016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0a6e76a-32de-4a6c-85ac-992098932b1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:08.871797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0a6e76a-32de-4a6c-85ac-992098932b1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:08.872244 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c0a6e76a-32de-4a6c-85ac-992098932b1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:08.922830 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-99d248ae-1b07-40ef-a62d-344ae66d9fba tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.217487 Aug 04 13:59:08.923861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 229/480] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:08 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:08.941681 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-77f75891-ee3c-4f2f-a17d-648794b27073 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:08.944180 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-77f75891-ee3c-4f2f-a17d-648794b27073 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:08.969716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-77f75891-ee3c-4f2f-a17d-648794b27073 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:08.970478 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-77f75891-ee3c-4f2f-a17d-648794b27073 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:08.971763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-77f75891-ee3c-4f2f-a17d-648794b27073 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:08.973671 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-77f75891-ee3c-4f2f-a17d-648794b27073 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:09.083824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c0a6e76a-32de-4a6c-85ac-992098932b1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.236604 Aug 04 13:59:09.088791 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 252/481] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:08 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:09.281636 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-77f75891-ee3c-4f2f-a17d-648794b27073 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:09.308902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-77f75891-ee3c-4f2f-a17d-648794b27073 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1515 microversion: 2.1 time: 0.372396 Aug 04 13:59:09.309591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 230/482] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:08 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:09.600875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1703431181", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "71fdc264-6c79-4112-8159-7717a7075144"}]}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:09.721314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] validate_networks() for [('71fdc264-6c79-4112-8159-7717a7075144', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:59:09.941119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b43b7b52-fd7f-4864-875d-1b835c90f88d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:09.942222 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b43b7b52-fd7f-4864-875d-1b835c90f88d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:09.953475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b43b7b52-fd7f-4864-875d-1b835c90f88d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:09.953944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b43b7b52-fd7f-4864-875d-1b835c90f88d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:09.954754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b43b7b52-fd7f-4864-875d-1b835c90f88d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:09.955186 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b43b7b52-fd7f-4864-875d-1b835c90f88d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:10.094391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b43b7b52-fd7f-4864-875d-1b835c90f88d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.161001 Aug 04 13:59:10.097203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 231/483] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:09 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:10.109110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1da811ae-f628-4c5d-868c-42fc1981f69e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:10.111962 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1da811ae-f628-4c5d-868c-42fc1981f69e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:10.126301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1da811ae-f628-4c5d-868c-42fc1981f69e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:10.127000 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1da811ae-f628-4c5d-868c-42fc1981f69e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:10.127908 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1da811ae-f628-4c5d-868c-42fc1981f69e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:10.128486 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1da811ae-f628-4c5d-868c-42fc1981f69e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:10.266100 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1da811ae-f628-4c5d-868c-42fc1981f69e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.163424 Aug 04 13:59:10.267167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 232/484] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:10 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:10.639279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:59:10.639805 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:59:10.640334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:59:10.640896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:59:10.641326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:59:10.650920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:10.651365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:10.652200 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:10.652647 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:10.671217 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Getting quotas for project 21c2c98b135f4239ab56572ec4a259e1. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:59:10.675826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Getting quotas for user f19e6144804c449586614d68ec2abe7b and project 21c2c98b135f4239ab56572ec4a259e1. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:59:10.689045 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:59:10.692975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:59:10.752273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9fbcbc6f-bc4d-485e-9215-d55c14a879aa tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166235 Aug 04 13:59:10.752918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 253/485] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:59:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:59:10.773733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-220cfc0b-82fb-4603-862a-8d5ded565f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:10.775838 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-220cfc0b-82fb-4603-862a-8d5ded565f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:10.857224 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-220cfc0b-82fb-4603-862a-8d5ded565f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:10.865131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-220cfc0b-82fb-4603-862a-8d5ded565f54 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1218 microversion: 2.1 time: 0.097310 Aug 04 13:59:10.866157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 233/486] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:10 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:11.112333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4e90a14f-8cbc-4c35-8609-d5f6fb639f35 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:11.113622 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4e90a14f-8cbc-4c35-8609-d5f6fb639f35 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:11.121847 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4e90a14f-8cbc-4c35-8609-d5f6fb639f35 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.122476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4e90a14f-8cbc-4c35-8609-d5f6fb639f35 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.124065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4e90a14f-8cbc-4c35-8609-d5f6fb639f35 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.124591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4e90a14f-8cbc-4c35-8609-d5f6fb639f35 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.136328 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-15f0f3a7-5fbb-4772-844f-a366adff11f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:11.137297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-15f0f3a7-5fbb-4772-844f-a366adff11f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:11.146272 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15f0f3a7-5fbb-4772-844f-a366adff11f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.147735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15f0f3a7-5fbb-4772-844f-a366adff11f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.149100 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15f0f3a7-5fbb-4772-844f-a366adff11f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.149943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15f0f3a7-5fbb-4772-844f-a366adff11f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.177653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-15f0f3a7-5fbb-4772-844f-a366adff11f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lazy-loading 'flavor' on Instance uuid 7ee769da-062a-4fe8-bd70-3dce1f031665 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:59:11.236422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4e90a14f-8cbc-4c35-8609-d5f6fb639f35 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.130693 Aug 04 13:59:11.237278 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 254/487] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:11 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:11.282620 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e8e027bf-326e-4b1f-b51e-45e2f13a89bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:11.284660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e8e027bf-326e-4b1f-b51e-45e2f13a89bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:11.295352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8e027bf-326e-4b1f-b51e-45e2f13a89bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.296465 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8e027bf-326e-4b1f-b51e-45e2f13a89bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.297307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8e027bf-326e-4b1f-b51e-45e2f13a89bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.297735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8e027bf-326e-4b1f-b51e-45e2f13a89bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.330056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-15f0f3a7-5fbb-4772-844f-a366adff11f0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/action" status: 200 len: 32 microversion: 2.1 time: 0.197794 Aug 04 13:59:11.331447 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 234/488] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:11 2021] POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:59:11.343260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cbb4b339-c3dd-4c79-8981-a43be40ab413 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:11.344196 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cbb4b339-c3dd-4c79-8981-a43be40ab413 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:11.357057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cbb4b339-c3dd-4c79-8981-a43be40ab413 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.357057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cbb4b339-c3dd-4c79-8981-a43be40ab413 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.359454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cbb4b339-c3dd-4c79-8981-a43be40ab413 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.359454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cbb4b339-c3dd-4c79-8981-a43be40ab413 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.491031 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e8e027bf-326e-4b1f-b51e-45e2f13a89bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.216153 Aug 04 13:59:11.491713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 255/489] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:11 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:11.556203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cbb4b339-c3dd-4c79-8981-a43be40ab413 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:11.567435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cbb4b339-c3dd-4c79-8981-a43be40ab413 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.229952 Aug 04 13:59:11.568190 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 235/490] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:11 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:11.884683 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b22af08-6760-4b83-a30b-a4e69b993709 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:11.885515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b22af08-6760-4b83-a30b-a4e69b993709 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:11.893781 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b22af08-6760-4b83-a30b-a4e69b993709 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.894221 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b22af08-6760-4b83-a30b-a4e69b993709 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.895005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b22af08-6760-4b83-a30b-a4e69b993709 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:11.895436 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b22af08-6760-4b83-a30b-a4e69b993709 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:11.980322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1b22af08-6760-4b83-a30b-a4e69b993709 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:11.988155 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b22af08-6760-4b83-a30b-a4e69b993709 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1270 microversion: 2.1 time: 0.108137 Aug 04 13:59:11.988826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 256/491] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:11 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:12.254377 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5678c6d7-42c7-45a7-be6c-ad2793a487dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:12.256028 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5678c6d7-42c7-45a7-be6c-ad2793a487dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:12.269078 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5678c6d7-42c7-45a7-be6c-ad2793a487dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:12.270562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5678c6d7-42c7-45a7-be6c-ad2793a487dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:12.272034 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5678c6d7-42c7-45a7-be6c-ad2793a487dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:12.273217 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5678c6d7-42c7-45a7-be6c-ad2793a487dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:12.425897 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5678c6d7-42c7-45a7-be6c-ad2793a487dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.179940 Aug 04 13:59:12.431754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 236/492] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:12 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:12.503789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7fa6224c-c97b-4c3e-8892-245c8105a437 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:12.505183 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7fa6224c-c97b-4c3e-8892-245c8105a437 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:12.517842 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fa6224c-c97b-4c3e-8892-245c8105a437 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:12.518395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fa6224c-c97b-4c3e-8892-245c8105a437 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:12.519256 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fa6224c-c97b-4c3e-8892-245c8105a437 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:12.519879 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fa6224c-c97b-4c3e-8892-245c8105a437 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:12.586439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-822a5223-83b1-4492-94b6-e2faff396084 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:12.588569 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-822a5223-83b1-4492-94b6-e2faff396084 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:12.607361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-822a5223-83b1-4492-94b6-e2faff396084 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:12.609822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-822a5223-83b1-4492-94b6-e2faff396084 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:12.615371 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-822a5223-83b1-4492-94b6-e2faff396084 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:12.617687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-822a5223-83b1-4492-94b6-e2faff396084 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:12.652564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7fa6224c-c97b-4c3e-8892-245c8105a437 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.151563 Aug 04 13:59:12.655074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 257/493] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:12 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:12.760998 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-810405645", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:12.829900 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] validate_networks() for None {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 13:59:12.954921 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-822a5223-83b1-4492-94b6-e2faff396084 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:12.979656 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-822a5223-83b1-4492-94b6-e2faff396084 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.397366 Aug 04 13:59:12.981905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 237/494] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:12 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:13.011291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ad9c9afb-c252-4d05-8377-1eef327c56ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:13.012058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ad9c9afb-c252-4d05-8377-1eef327c56ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:13.036772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ad9c9afb-c252-4d05-8377-1eef327c56ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:13.037232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ad9c9afb-c252-4d05-8377-1eef327c56ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:13.038092 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ad9c9afb-c252-4d05-8377-1eef327c56ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:13.038537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ad9c9afb-c252-4d05-8377-1eef327c56ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:13.175012 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ad9c9afb-c252-4d05-8377-1eef327c56ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:13.191573 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ad9c9afb-c252-4d05-8377-1eef327c56ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1276 microversion: 2.1 time: 0.185660 Aug 04 13:59:13.192246 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 238/495] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:13 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:13.246177 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:59:13.247170 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:59:13.247731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:59:13.248863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:59:13.249275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:59:13.261253 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:13.262511 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:13.264450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:13.265456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:13.288690 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Getting quotas for project 8ee2ff3dd6d94912a0b3f2ac0ba73ab9. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 13:59:13.295789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Getting quotas for user 7028bcd7c499450b81db4c8931be31a7 and project 8ee2ff3dd6d94912a0b3f2ac0ba73ab9. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 13:59:13.309743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 13:59:13.313288 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 13:59:13.408583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ba520abd-cb42-4ca4-996a-95037b2e6990 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651687 Aug 04 13:59:13.409550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 258/496] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 13:59:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:59:13.421175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-059a0066-b69a-4545-a640-b7e65af71c81 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:13.421895 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-059a0066-b69a-4545-a640-b7e65af71c81 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:13.439458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7cf9e1b6-ca14-48e0-a0e0-e07dcadeee2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:13.441622 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7cf9e1b6-ca14-48e0-a0e0-e07dcadeee2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:13.455379 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7cf9e1b6-ca14-48e0-a0e0-e07dcadeee2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:13.458227 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7cf9e1b6-ca14-48e0-a0e0-e07dcadeee2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:13.459723 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7cf9e1b6-ca14-48e0-a0e0-e07dcadeee2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:13.460717 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7cf9e1b6-ca14-48e0-a0e0-e07dcadeee2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:13.587010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7cf9e1b6-ca14-48e0-a0e0-e07dcadeee2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.152498 Aug 04 13:59:13.587689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 259/497] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:13 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:13.625473 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-059a0066-b69a-4545-a640-b7e65af71c81 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:13.636561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-059a0066-b69a-4545-a640-b7e65af71c81 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1214 microversion: 2.1 time: 0.220109 Aug 04 13:59:13.639289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 239/498] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:13 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:13.679661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-50681397-8fd7-4ef8-b8fd-649adad91fcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:13.683093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-50681397-8fd7-4ef8-b8fd-649adad91fcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:13.700394 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50681397-8fd7-4ef8-b8fd-649adad91fcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:13.701030 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50681397-8fd7-4ef8-b8fd-649adad91fcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:13.703592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50681397-8fd7-4ef8-b8fd-649adad91fcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:13.704313 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50681397-8fd7-4ef8-b8fd-649adad91fcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:13.825841 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-50681397-8fd7-4ef8-b8fd-649adad91fcb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.151125 Aug 04 13:59:13.828449 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 260/499] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:13 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:14.001261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-adbe244e-5ad4-4d34-82d7-e8c997078a69 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:14.002412 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-adbe244e-5ad4-4d34-82d7-e8c997078a69 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:14.019747 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adbe244e-5ad4-4d34-82d7-e8c997078a69 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.021227 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adbe244e-5ad4-4d34-82d7-e8c997078a69 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.022905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adbe244e-5ad4-4d34-82d7-e8c997078a69 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.023963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adbe244e-5ad4-4d34-82d7-e8c997078a69 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.227060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6ed4ce41-cf3d-452b-ad45-cd77fcda5318 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:14.228452 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6ed4ce41-cf3d-452b-ad45-cd77fcda5318 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:14.245935 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ed4ce41-cf3d-452b-ad45-cd77fcda5318 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.246618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ed4ce41-cf3d-452b-ad45-cd77fcda5318 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.249353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ed4ce41-cf3d-452b-ad45-cd77fcda5318 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.249858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ed4ce41-cf3d-452b-ad45-cd77fcda5318 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.371942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-adbe244e-5ad4-4d34-82d7-e8c997078a69 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:14.380464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-adbe244e-5ad4-4d34-82d7-e8c997078a69 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.386939 Aug 04 13:59:14.381663 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 240/500] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:13 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:14.418156 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6ed4ce41-cf3d-452b-ad45-cd77fcda5318 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:14.427955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6ed4ce41-cf3d-452b-ad45-cd77fcda5318 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.209130 Aug 04 13:59:14.428702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 261/501] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:14 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:14.603322 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-df5565c7-7732-4248-974a-a53976eba7c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:14.605363 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-df5565c7-7732-4248-974a-a53976eba7c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:14.616341 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-df5565c7-7732-4248-974a-a53976eba7c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.617037 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-df5565c7-7732-4248-974a-a53976eba7c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.617841 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-df5565c7-7732-4248-974a-a53976eba7c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.618346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-df5565c7-7732-4248-974a-a53976eba7c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.658594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8a9a7c0b-6825-4e79-92c7-2fc663565264 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:14.660079 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8a9a7c0b-6825-4e79-92c7-2fc663565264 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:14.681684 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a9a7c0b-6825-4e79-92c7-2fc663565264 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.686548 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a9a7c0b-6825-4e79-92c7-2fc663565264 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.687489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a9a7c0b-6825-4e79-92c7-2fc663565264 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.689460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8a9a7c0b-6825-4e79-92c7-2fc663565264 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.772974 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-df5565c7-7732-4248-974a-a53976eba7c8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.175771 Aug 04 13:59:14.779022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 241/502] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:14 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:14.804208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8a9a7c0b-6825-4e79-92c7-2fc663565264 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:14.817995 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8a9a7c0b-6825-4e79-92c7-2fc663565264 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1266 microversion: 2.1 time: 0.164383 Aug 04 13:59:14.824449 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 262/503] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:14 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:14.841715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8e2f204f-e97d-4d63-b75f-aca53986df6c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:14.844667 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8e2f204f-e97d-4d63-b75f-aca53986df6c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:14.856651 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e2f204f-e97d-4d63-b75f-aca53986df6c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.858414 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e2f204f-e97d-4d63-b75f-aca53986df6c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.860099 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e2f204f-e97d-4d63-b75f-aca53986df6c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.860370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-a5262377-8a74-4968-a940-03afd4c21862 req-a893091a-90fd-4190-b5a2-e0e8c915b885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b58917f-f9cf-44fc-9710-66a328803d79", "tag": "83f9b0c4-dded-4107-9f3a-6d8a68ac1f41"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:14.861026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e2f204f-e97d-4d63-b75f-aca53986df6c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.862003 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:59:14.862003 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:59:14.887081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-a5262377-8a74-4968-a940-03afd4c21862 req-a893091a-90fd-4190-b5a2-e0e8c915b885 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:14.887743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-a5262377-8a74-4968-a940-03afd4c21862 req-a893091a-90fd-4190-b5a2-e0e8c915b885 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:14.910927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-a5262377-8a74-4968-a940-03afd4c21862 req-a893091a-90fd-4190-b5a2-e0e8c915b885 service nova] Creating event network-changed:83f9b0c4-dded-4107-9f3a-6d8a68ac1f41 for instance 6b58917f-f9cf-44fc-9710-66a328803d79 on hv-cinder-79264 Aug 04 13:59:14.917121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-a5262377-8a74-4968-a940-03afd4c21862 req-a893091a-90fd-4190-b5a2-e0e8c915b885 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069543 Aug 04 13:59:14.918212 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 263/504] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:59:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:15.012232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8e2f204f-e97d-4d63-b75f-aca53986df6c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.176558 Aug 04 13:59:15.019477 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 242/505] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:14 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:15.401153 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cb8ed559-9363-4689-a406-6ef03dc32633 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:15.402225 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cb8ed559-9363-4689-a406-6ef03dc32633 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:15.411651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cb8ed559-9363-4689-a406-6ef03dc32633 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:15.412423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cb8ed559-9363-4689-a406-6ef03dc32633 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:15.413483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cb8ed559-9363-4689-a406-6ef03dc32633 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:15.413910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cb8ed559-9363-4689-a406-6ef03dc32633 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:15.454345 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2f784b87-ef3c-4641-ab93-8d35c7c0e4a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:15.455430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2f784b87-ef3c-4641-ab93-8d35c7c0e4a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:15.467307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2f784b87-ef3c-4641-ab93-8d35c7c0e4a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:15.475627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2f784b87-ef3c-4641-ab93-8d35c7c0e4a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:15.477315 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2f784b87-ef3c-4641-ab93-8d35c7c0e4a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:15.477950 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2f784b87-ef3c-4641-ab93-8d35c7c0e4a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:15.686255 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cb8ed559-9363-4689-a406-6ef03dc32633 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:15.694123 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cb8ed559-9363-4689-a406-6ef03dc32633 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.299785 Aug 04 13:59:15.694715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 264/506] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:15 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:15.792299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-acdd618f-a3f8-4cd3-8bb7-4fd082cb9c63 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:15.793972 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-acdd618f-a3f8-4cd3-8bb7-4fd082cb9c63 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:15.846038 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2f784b87-ef3c-4641-ab93-8d35c7c0e4a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:15.853493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acdd618f-a3f8-4cd3-8bb7-4fd082cb9c63 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:15.853993 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acdd618f-a3f8-4cd3-8bb7-4fd082cb9c63 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:15.854940 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acdd618f-a3f8-4cd3-8bb7-4fd082cb9c63 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:15.855382 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acdd618f-a3f8-4cd3-8bb7-4fd082cb9c63 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:15.857301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2f784b87-ef3c-4641-ab93-8d35c7c0e4a2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.414039 Aug 04 13:59:15.858046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 243/507] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:15 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:15.877266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4100990d-662e-43e3-b7bc-8bcd29241ec3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:15.881035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4100990d-662e-43e3-b7bc-8bcd29241ec3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:15.898958 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4100990d-662e-43e3-b7bc-8bcd29241ec3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:15.899765 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4100990d-662e-43e3-b7bc-8bcd29241ec3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:15.901712 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4100990d-662e-43e3-b7bc-8bcd29241ec3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:15.903723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4100990d-662e-43e3-b7bc-8bcd29241ec3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:16.028282 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4100990d-662e-43e3-b7bc-8bcd29241ec3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:16.036511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4100990d-662e-43e3-b7bc-8bcd29241ec3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1272 microversion: 2.1 time: 0.162955 Aug 04 13:59:16.048662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 244/508] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:15 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:16.048662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-51fd63bd-bd8f-4908-a077-18793a0f4b81 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:16.048662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-51fd63bd-bd8f-4908-a077-18793a0f4b81 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:16.066111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-51fd63bd-bd8f-4908-a077-18793a0f4b81 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:16.066111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-51fd63bd-bd8f-4908-a077-18793a0f4b81 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:16.066601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-51fd63bd-bd8f-4908-a077-18793a0f4b81 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:16.066601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-51fd63bd-bd8f-4908-a077-18793a0f4b81 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:16.301423 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-51fd63bd-bd8f-4908-a077-18793a0f4b81 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.258928 Aug 04 13:59:16.302061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 245/509] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:16 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:16.323711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-acdd618f-a3f8-4cd3-8bb7-4fd082cb9c63 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28218 microversion: 2.1 time: 0.539506 Aug 04 13:59:16.325065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 265/510] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:15 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28218 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:16.722501 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9f45739c-f6dc-4ead-b4f0-ab216871e6b9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:16.723223 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9f45739c-f6dc-4ead-b4f0-ab216871e6b9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:16.739787 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9f45739c-f6dc-4ead-b4f0-ab216871e6b9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:16.740908 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9f45739c-f6dc-4ead-b4f0-ab216871e6b9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:16.744327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9f45739c-f6dc-4ead-b4f0-ab216871e6b9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:16.746033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9f45739c-f6dc-4ead-b4f0-ab216871e6b9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:16.878797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-efc8b796-39ab-4f9b-a6dd-f4f19c2dfb1c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:16.879602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-efc8b796-39ab-4f9b-a6dd-f4f19c2dfb1c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:16.892630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efc8b796-39ab-4f9b-a6dd-f4f19c2dfb1c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:16.893181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efc8b796-39ab-4f9b-a6dd-f4f19c2dfb1c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:16.894050 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efc8b796-39ab-4f9b-a6dd-f4f19c2dfb1c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:16.894714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efc8b796-39ab-4f9b-a6dd-f4f19c2dfb1c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:16.960284 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9f45739c-f6dc-4ead-b4f0-ab216871e6b9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:16.975470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9f45739c-f6dc-4ead-b4f0-ab216871e6b9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.260231 Aug 04 13:59:16.977189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 246/511] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:16 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:17.062361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8642445b-c7b9-4cff-b79b-345503fa30da tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:17.063098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8642445b-c7b9-4cff-b79b-345503fa30da tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:17.069261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8642445b-c7b9-4cff-b79b-345503fa30da tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:17.069780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8642445b-c7b9-4cff-b79b-345503fa30da tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:17.070667 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8642445b-c7b9-4cff-b79b-345503fa30da tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:17.071171 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8642445b-c7b9-4cff-b79b-345503fa30da tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:17.238176 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8642445b-c7b9-4cff-b79b-345503fa30da tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:17.245830 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8642445b-c7b9-4cff-b79b-345503fa30da tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.188056 Aug 04 13:59:17.246526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 247/512] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:17 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:17.250143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-efc8b796-39ab-4f9b-a6dd-f4f19c2dfb1c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:17.257765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-efc8b796-39ab-4f9b-a6dd-f4f19c2dfb1c tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.386117 Aug 04 13:59:17.258331 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 266/513] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:16 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:17.313855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6880c612-f319-451c-98af-974f241741b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:17.314818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6880c612-f319-451c-98af-974f241741b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:17.320687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6880c612-f319-451c-98af-974f241741b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:17.321137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6880c612-f319-451c-98af-974f241741b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:17.322177 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6880c612-f319-451c-98af-974f241741b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:17.322601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6880c612-f319-451c-98af-974f241741b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:17.337767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c7ccdc63-b42b-437c-9c35-2585bc0e4388 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:17.339074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c7ccdc63-b42b-437c-9c35-2585bc0e4388 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:17.346258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7ccdc63-b42b-437c-9c35-2585bc0e4388 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:17.346721 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7ccdc63-b42b-437c-9c35-2585bc0e4388 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:17.347654 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7ccdc63-b42b-437c-9c35-2585bc0e4388 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:17.348266 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7ccdc63-b42b-437c-9c35-2585bc0e4388 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:17.445106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6880c612-f319-451c-98af-974f241741b6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.134416 Aug 04 13:59:17.449616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 248/514] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:17 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:17.492451 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c7ccdc63-b42b-437c-9c35-2585bc0e4388 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28509 microversion: 2.1 time: 0.158107 Aug 04 13:59:17.493123 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 267/515] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:17 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:17.976078 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-9723fc84-81c6-497d-b9b4-e0266515255f req-d39bca5d-b7aa-4e2d-80dc-5662d06d6d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a551b4b1-d7e9-49f9-9516-e0c6538d764a", "tag": "75707259-ef90-4e88-b098-74e592e529be"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:17.978192 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:59:17.978192 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:59:17.996892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-871958e8-1aab-47ca-b592-fe592ebf9d97 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:17.997744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-871958e8-1aab-47ca-b592-fe592ebf9d97 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:18.007353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-9723fc84-81c6-497d-b9b4-e0266515255f req-d39bca5d-b7aa-4e2d-80dc-5662d06d6d86 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.007676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-9723fc84-81c6-497d-b9b4-e0266515255f req-d39bca5d-b7aa-4e2d-80dc-5662d06d6d86 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.014700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-871958e8-1aab-47ca-b592-fe592ebf9d97 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.015459 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-871958e8-1aab-47ca-b592-fe592ebf9d97 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.023792 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-871958e8-1aab-47ca-b592-fe592ebf9d97 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.024584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-871958e8-1aab-47ca-b592-fe592ebf9d97 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.026820 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-9723fc84-81c6-497d-b9b4-e0266515255f req-d39bca5d-b7aa-4e2d-80dc-5662d06d6d86 service nova] Creating event network-changed:75707259-ef90-4e88-b098-74e592e529be for instance a551b4b1-d7e9-49f9-9516-e0c6538d764a on hv-cinder-79264 Aug 04 13:59:18.045606 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-9723fc84-81c6-497d-b9b4-e0266515255f req-d39bca5d-b7aa-4e2d-80dc-5662d06d6d86 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072890 Aug 04 13:59:18.046666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 249/516] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:59:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:18.263499 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-64bdac4d-48b2-4347-af44-68a69c1fbbcf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.264426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-64bdac4d-48b2-4347-af44-68a69c1fbbcf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:18.272471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64bdac4d-48b2-4347-af44-68a69c1fbbcf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.273188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64bdac4d-48b2-4347-af44-68a69c1fbbcf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.274716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64bdac4d-48b2-4347-af44-68a69c1fbbcf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.275495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64bdac4d-48b2-4347-af44-68a69c1fbbcf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.309819 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-871958e8-1aab-47ca-b592-fe592ebf9d97 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:18.320076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-871958e8-1aab-47ca-b592-fe592ebf9d97 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.327313 Aug 04 13:59:18.322373 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 268/517] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:17 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:18.331917 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ae08ba3b-fbfa-49df-8816-339d67919840 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.332938 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ae08ba3b-fbfa-49df-8816-339d67919840 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:18.351839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ae08ba3b-fbfa-49df-8816-339d67919840 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.356607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ae08ba3b-fbfa-49df-8816-339d67919840 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.362253 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ae08ba3b-fbfa-49df-8816-339d67919840 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.363067 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ae08ba3b-fbfa-49df-8816-339d67919840 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.506144 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-64bdac4d-48b2-4347-af44-68a69c1fbbcf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:18.518943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-64bdac4d-48b2-4347-af44-68a69c1fbbcf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.259616 Aug 04 13:59:18.520461 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 250/518] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:18 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:18.525740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0a2bd2c6-523f-4248-9795-3b793e208531 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:18.526997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0a2bd2c6-523f-4248-9795-3b793e208531 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:18.538913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a2bd2c6-523f-4248-9795-3b793e208531 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.540593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a2bd2c6-523f-4248-9795-3b793e208531 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.543121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a2bd2c6-523f-4248-9795-3b793e208531 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.544384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a2bd2c6-523f-4248-9795-3b793e208531 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.656008 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ae08ba3b-fbfa-49df-8816-339d67919840 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:18.664337 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ae08ba3b-fbfa-49df-8816-339d67919840 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.340669 Aug 04 13:59:18.664874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 269/519] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:18 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:18.672887 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-552d205f-e156-4751-b990-816d8289a085 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:18.674166 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-552d205f-e156-4751-b990-816d8289a085 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:18.680392 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-552d205f-e156-4751-b990-816d8289a085 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.680931 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-552d205f-e156-4751-b990-816d8289a085 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.681775 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-552d205f-e156-4751-b990-816d8289a085 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:18.682308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-552d205f-e156-4751-b990-816d8289a085 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:18.787556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0a2bd2c6-523f-4248-9795-3b793e208531 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28214 microversion: 2.20 time: 0.257252 Aug 04 13:59:18.802073 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 251/520] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:18 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:18.890653 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-552d205f-e156-4751-b990-816d8289a085 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28509 microversion: 2.1 time: 0.224571 Aug 04 13:59:18.891881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 270/521] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:18 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:19.346482 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-93853116-7876-4e86-b404-9bb98249e45e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:19.347894 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-93853116-7876-4e86-b404-9bb98249e45e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:19.382233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-93853116-7876-4e86-b404-9bb98249e45e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:19.382233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-93853116-7876-4e86-b404-9bb98249e45e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:19.383267 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-93853116-7876-4e86-b404-9bb98249e45e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:19.384244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-93853116-7876-4e86-b404-9bb98249e45e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:19.537860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-427796ed-552d-40c0-a4d5-a76c751b8017 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:19.539479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-427796ed-552d-40c0-a4d5-a76c751b8017 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:19.548205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-427796ed-552d-40c0-a4d5-a76c751b8017 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:19.548696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-427796ed-552d-40c0-a4d5-a76c751b8017 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:19.549568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-427796ed-552d-40c0-a4d5-a76c751b8017 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:19.550065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-427796ed-552d-40c0-a4d5-a76c751b8017 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:19.583283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-93853116-7876-4e86-b404-9bb98249e45e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:19.603506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-93853116-7876-4e86-b404-9bb98249e45e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.267938 Aug 04 13:59:19.604619 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 252/522] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:19 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:19.683046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-194499a5-bce7-486b-9518-f30e963c1ae2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:19.683513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-194499a5-bce7-486b-9518-f30e963c1ae2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:19.692021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-194499a5-bce7-486b-9518-f30e963c1ae2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:19.692492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-194499a5-bce7-486b-9518-f30e963c1ae2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:19.693297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-194499a5-bce7-486b-9518-f30e963c1ae2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:19.693728 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-194499a5-bce7-486b-9518-f30e963c1ae2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:19.848873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-194499a5-bce7-486b-9518-f30e963c1ae2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:19.859801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-194499a5-bce7-486b-9518-f30e963c1ae2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.181051 Aug 04 13:59:19.860421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 253/523] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:19 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:19.866078 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5cd40cf5-acc1-4451-af39-d58eeab823c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:19.867329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5cd40cf5-acc1-4451-af39-d58eeab823c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:19.874406 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5cd40cf5-acc1-4451-af39-d58eeab823c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:19.875110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5cd40cf5-acc1-4451-af39-d58eeab823c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:19.876045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5cd40cf5-acc1-4451-af39-d58eeab823c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:19.876601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5cd40cf5-acc1-4451-af39-d58eeab823c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:19.986009 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-427796ed-552d-40c0-a4d5-a76c751b8017 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:19.994404 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-427796ed-552d-40c0-a4d5-a76c751b8017 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.460956 Aug 04 13:59:19.995098 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 271/524] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:19 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:20.000676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-438dc4cf-548c-4cd6-899d-8194ccce46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:20.001648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-438dc4cf-548c-4cd6-899d-8194ccce46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:20.008309 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-438dc4cf-548c-4cd6-899d-8194ccce46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:20.008844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-438dc4cf-548c-4cd6-899d-8194ccce46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:20.009699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-438dc4cf-548c-4cd6-899d-8194ccce46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:20.010181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-438dc4cf-548c-4cd6-899d-8194ccce46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:20.041560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5cd40cf5-acc1-4451-af39-d58eeab823c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28492 microversion: 2.20 time: 0.179835 Aug 04 13:59:20.042213 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 254/525] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:19 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28492 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:20.220095 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-438dc4cf-548c-4cd6-899d-8194ccce46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.223716 Aug 04 13:59:20.221532 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 272/526] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:19 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:20.622426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d1566dbc-ca6b-409e-9ad9-b2b0a418fb57 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:20.623972 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d1566dbc-ca6b-409e-9ad9-b2b0a418fb57 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:20.630876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d1566dbc-ca6b-409e-9ad9-b2b0a418fb57 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:20.631632 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d1566dbc-ca6b-409e-9ad9-b2b0a418fb57 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:20.632715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d1566dbc-ca6b-409e-9ad9-b2b0a418fb57 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:20.633171 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d1566dbc-ca6b-409e-9ad9-b2b0a418fb57 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:20.803964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d1566dbc-ca6b-409e-9ad9-b2b0a418fb57 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:20.813960 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d1566dbc-ca6b-409e-9ad9-b2b0a418fb57 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.195159 Aug 04 13:59:20.815461 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 255/527] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:20 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:20.877822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3391ce14-00f4-4721-92fb-f3ef415e52ce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:20.878726 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3391ce14-00f4-4721-92fb-f3ef415e52ce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:20.886659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3391ce14-00f4-4721-92fb-f3ef415e52ce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:20.887100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3391ce14-00f4-4721-92fb-f3ef415e52ce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:20.888107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3391ce14-00f4-4721-92fb-f3ef415e52ce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:20.889224 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3391ce14-00f4-4721-92fb-f3ef415e52ce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.011921 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-db711e6f-9b1e-4840-8afd-e7aabc39d853 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:21.012543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-db711e6f-9b1e-4840-8afd-e7aabc39d853 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:21.019384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-db711e6f-9b1e-4840-8afd-e7aabc39d853 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:21.019848 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-db711e6f-9b1e-4840-8afd-e7aabc39d853 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.020837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-db711e6f-9b1e-4840-8afd-e7aabc39d853 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:21.021275 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-db711e6f-9b1e-4840-8afd-e7aabc39d853 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.031687 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3391ce14-00f4-4721-92fb-f3ef415e52ce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:21.045734 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3391ce14-00f4-4721-92fb-f3ef415e52ce tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.171797 Aug 04 13:59:21.046881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 273/528] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:20 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:21.058368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4cafd37b-6697-44db-bedd-034cd7b3885e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:21.059353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4cafd37b-6697-44db-bedd-034cd7b3885e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:21.067514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4cafd37b-6697-44db-bedd-034cd7b3885e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:21.067955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4cafd37b-6697-44db-bedd-034cd7b3885e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.068784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4cafd37b-6697-44db-bedd-034cd7b3885e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:21.069326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4cafd37b-6697-44db-bedd-034cd7b3885e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.167209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-db711e6f-9b1e-4840-8afd-e7aabc39d853 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:21.175822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-db711e6f-9b1e-4840-8afd-e7aabc39d853 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.167676 Aug 04 13:59:21.177066 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 256/529] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:21 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:21.193111 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4cafd37b-6697-44db-bedd-034cd7b3885e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28492 microversion: 2.20 time: 0.138907 Aug 04 13:59:21.193773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 274/530] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:21 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28492 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:21.231197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-45dd7322-ba4d-46f8-bf06-4781fa2970ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:21.232439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-45dd7322-ba4d-46f8-bf06-4781fa2970ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:21.238498 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45dd7322-ba4d-46f8-bf06-4781fa2970ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:21.239058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45dd7322-ba4d-46f8-bf06-4781fa2970ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.239920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45dd7322-ba4d-46f8-bf06-4781fa2970ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:21.240460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45dd7322-ba4d-46f8-bf06-4781fa2970ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.832359 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5fe07dfe-d4f6-4e1d-9fd6-5c5186f048dc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:21.833036 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5fe07dfe-d4f6-4e1d-9fd6-5c5186f048dc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:21.839848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5fe07dfe-d4f6-4e1d-9fd6-5c5186f048dc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:21.840325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5fe07dfe-d4f6-4e1d-9fd6-5c5186f048dc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.841077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5fe07dfe-d4f6-4e1d-9fd6-5c5186f048dc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:21.841580 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5fe07dfe-d4f6-4e1d-9fd6-5c5186f048dc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:21.986390 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5fe07dfe-d4f6-4e1d-9fd6-5c5186f048dc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:21.993791 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5fe07dfe-d4f6-4e1d-9fd6-5c5186f048dc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.165453 Aug 04 13:59:21.994358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 275/531] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:21 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:22.063148 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4a2e8490-9e11-4c79-a7d3-63c1f02b6427 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:22.063747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4a2e8490-9e11-4c79-a7d3-63c1f02b6427 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:22.069729 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a2e8490-9e11-4c79-a7d3-63c1f02b6427 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:22.070172 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a2e8490-9e11-4c79-a7d3-63c1f02b6427 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:22.070943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a2e8490-9e11-4c79-a7d3-63c1f02b6427 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:22.071365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4a2e8490-9e11-4c79-a7d3-63c1f02b6427 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:22.201871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4a2e8490-9e11-4c79-a7d3-63c1f02b6427 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:22.209372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4a2e8490-9e11-4c79-a7d3-63c1f02b6427 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.149861 Aug 04 13:59:22.209939 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 276/532] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:22 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:22.214275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8ec60826-ef23-4d33-b924-31eaf854edf3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:22.214873 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8ec60826-ef23-4d33-b924-31eaf854edf3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:22.221853 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ec60826-ef23-4d33-b924-31eaf854edf3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:22.222323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ec60826-ef23-4d33-b924-31eaf854edf3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:22.223108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ec60826-ef23-4d33-b924-31eaf854edf3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:22.223534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ec60826-ef23-4d33-b924-31eaf854edf3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:22.352656 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8ec60826-ef23-4d33-b924-31eaf854edf3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:22.360247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8ec60826-ef23-4d33-b924-31eaf854edf3 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.149247 Aug 04 13:59:22.360839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 277/533] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:22 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:22.365590 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-110f3c87-4100-46fc-ad05-74303d8d7c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:22.366552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-110f3c87-4100-46fc-ad05-74303d8d7c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:22.373043 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-110f3c87-4100-46fc-ad05-74303d8d7c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:22.373676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-110f3c87-4100-46fc-ad05-74303d8d7c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:22.374450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-110f3c87-4100-46fc-ad05-74303d8d7c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:22.374875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-110f3c87-4100-46fc-ad05-74303d8d7c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:25.381145 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-45dd7322-ba4d-46f8-bf06-4781fa2970ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 4.153358 Aug 04 13:59:25.381852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 257/534] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:21 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 4155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:25.387439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5332032c-e628-495f-a164-a0df4c1cd329 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:25.388137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5332032c-e628-495f-a164-a0df4c1cd329 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:25.394755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5332032c-e628-495f-a164-a0df4c1cd329 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:25.395200 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5332032c-e628-495f-a164-a0df4c1cd329 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:25.395986 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5332032c-e628-495f-a164-a0df4c1cd329 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:25.396448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5332032c-e628-495f-a164-a0df4c1cd329 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:25.420870 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-110f3c87-4100-46fc-ad05-74303d8d7c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28677 microversion: 2.20 time: 3.058129 Aug 04 13:59:25.422635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 278/535] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:22 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28677 bytes in 3060 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:25.427316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a829d6c4-3fbf-4d43-a5e3-6b48787ae456 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:25.428000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a829d6c4-3fbf-4d43-a5e3-6b48787ae456 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:25.435016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a829d6c4-3fbf-4d43-a5e3-6b48787ae456 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:25.435532 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a829d6c4-3fbf-4d43-a5e3-6b48787ae456 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:25.436839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a829d6c4-3fbf-4d43-a5e3-6b48787ae456 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:25.437463 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a829d6c4-3fbf-4d43-a5e3-6b48787ae456 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:25.569620 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5332032c-e628-495f-a164-a0df4c1cd329 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:25.581928 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5332032c-e628-495f-a164-a0df4c1cd329 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.198056 Aug 04 13:59:25.583221 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 258/536] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:25 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:25.591750 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a829d6c4-3fbf-4d43-a5e3-6b48787ae456 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:25.595637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fdb2b172-02a6-4931-aef4-2be18db6582b tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:25.596275 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fdb2b172-02a6-4931-aef4-2be18db6582b tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:25.601253 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a829d6c4-3fbf-4d43-a5e3-6b48787ae456 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.178243 Aug 04 13:59:25.601832 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 279/537] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:25 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:25.602136 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fdb2b172-02a6-4931-aef4-2be18db6582b tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:25.602585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fdb2b172-02a6-4931-aef4-2be18db6582b tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:25.603514 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fdb2b172-02a6-4931-aef4-2be18db6582b tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:25.603920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fdb2b172-02a6-4931-aef4-2be18db6582b tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:25.732043 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fdb2b172-02a6-4931-aef4-2be18db6582b tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:25.741149 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fdb2b172-02a6-4931-aef4-2be18db6582b tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.156489 Aug 04 13:59:25.741717 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 259/538] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:25 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:26.393846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8c6b0604-e282-4da5-9261-782d48d26835 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:26.394790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8c6b0604-e282-4da5-9261-782d48d26835 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:26.400742 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8c6b0604-e282-4da5-9261-782d48d26835 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.401176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8c6b0604-e282-4da5-9261-782d48d26835 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.401927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8c6b0604-e282-4da5-9261-782d48d26835 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.402349 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8c6b0604-e282-4da5-9261-782d48d26835 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.433003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5b92e14a-9e4b-4593-a3f0-7f24602404b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:26.433969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5b92e14a-9e4b-4593-a3f0-7f24602404b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:26.440905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b92e14a-9e4b-4593-a3f0-7f24602404b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.441345 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b92e14a-9e4b-4593-a3f0-7f24602404b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.442131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b92e14a-9e4b-4593-a3f0-7f24602404b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.442560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b92e14a-9e4b-4593-a3f0-7f24602404b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.553850 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5b92e14a-9e4b-4593-a3f0-7f24602404b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.124396 Aug 04 13:59:26.557948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 260/539] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:26 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:26.580986 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8c6b0604-e282-4da5-9261-782d48d26835 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.191590 Aug 04 13:59:26.581618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 280/540] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:26 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:26.601722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1b04a6e7-3e95-4893-b358-a4af0c6fb5ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:26.602512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1b04a6e7-3e95-4893-b358-a4af0c6fb5ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:26.610143 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b04a6e7-3e95-4893-b358-a4af0c6fb5ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.610612 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b04a6e7-3e95-4893-b358-a4af0c6fb5ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.611502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b04a6e7-3e95-4893-b358-a4af0c6fb5ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.618003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b04a6e7-3e95-4893-b358-a4af0c6fb5ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.628767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bdce9790-0b19-49cd-9ef8-789e8ea4e04e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:26.628767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bdce9790-0b19-49cd-9ef8-789e8ea4e04e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:26.637133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdce9790-0b19-49cd-9ef8-789e8ea4e04e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.637580 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdce9790-0b19-49cd-9ef8-789e8ea4e04e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.638386 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdce9790-0b19-49cd-9ef8-789e8ea4e04e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.638820 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdce9790-0b19-49cd-9ef8-789e8ea4e04e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.765133 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1b04a6e7-3e95-4893-b358-a4af0c6fb5ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:26.773482 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1b04a6e7-3e95-4893-b358-a4af0c6fb5ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.175941 Aug 04 13:59:26.774065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 261/541] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:26 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:26.780688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b96258cf-88bb-40ab-b919-137380366b8c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:26.781465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b96258cf-88bb-40ab-b919-137380366b8c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:26.787818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b96258cf-88bb-40ab-b919-137380366b8c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.788299 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b96258cf-88bb-40ab-b919-137380366b8c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.788569 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bdce9790-0b19-49cd-9ef8-789e8ea4e04e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:26.789115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b96258cf-88bb-40ab-b919-137380366b8c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:26.789549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b96258cf-88bb-40ab-b919-137380366b8c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:26.796081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bdce9790-0b19-49cd-9ef8-789e8ea4e04e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.173738 Aug 04 13:59:26.797016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 281/542] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:26 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:26.918867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b96258cf-88bb-40ab-b919-137380366b8c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:26.929792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b96258cf-88bb-40ab-b919-137380366b8c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.154416 Aug 04 13:59:26.930430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 262/543] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:26 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:27.565767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7fc54afd-7ed6-479a-9b9b-a19547e4a155 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:27.567218 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7fc54afd-7ed6-479a-9b9b-a19547e4a155 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:27.573658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fc54afd-7ed6-479a-9b9b-a19547e4a155 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:27.574120 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fc54afd-7ed6-479a-9b9b-a19547e4a155 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:27.574905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fc54afd-7ed6-479a-9b9b-a19547e4a155 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:27.575335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fc54afd-7ed6-479a-9b9b-a19547e4a155 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:27.595722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c4a7ae0c-8791-450f-b79d-1b817ac7d644 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:27.597291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c4a7ae0c-8791-450f-b79d-1b817ac7d644 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:27.605674 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c4a7ae0c-8791-450f-b79d-1b817ac7d644 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:27.606325 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c4a7ae0c-8791-450f-b79d-1b817ac7d644 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:27.607300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c4a7ae0c-8791-450f-b79d-1b817ac7d644 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:27.607953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c4a7ae0c-8791-450f-b79d-1b817ac7d644 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:31.801718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7fc54afd-7ed6-479a-9b9b-a19547e4a155 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 4.239366 Aug 04 13:59:31.802360 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 282/544] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:27 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 4241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:31.807699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1f37565e-312d-4fc0-90c3-361c6108365c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:31.808447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1f37565e-312d-4fc0-90c3-361c6108365c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:31.815505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f37565e-312d-4fc0-90c3-361c6108365c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:31.815946 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f37565e-312d-4fc0-90c3-361c6108365c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:31.818707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f37565e-312d-4fc0-90c3-361c6108365c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:31.818707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f37565e-312d-4fc0-90c3-361c6108365c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:31.821321 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c4a7ae0c-8791-450f-b79d-1b817ac7d644 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 4.230366 Aug 04 13:59:31.823640 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 263/545] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:27 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 4234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:31.835126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-21eea949-3a17-44f9-8763-bfdef1af5d82 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:31.836848 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-21eea949-3a17-44f9-8763-bfdef1af5d82 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:31.849930 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21eea949-3a17-44f9-8763-bfdef1af5d82 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:31.851019 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21eea949-3a17-44f9-8763-bfdef1af5d82 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:31.852563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21eea949-3a17-44f9-8763-bfdef1af5d82 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:31.853728 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21eea949-3a17-44f9-8763-bfdef1af5d82 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:32.010632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1f37565e-312d-4fc0-90c3-361c6108365c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:32.019448 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1f37565e-312d-4fc0-90c3-361c6108365c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.215849 Aug 04 13:59:32.020110 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 283/546] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:31 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:32.024868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-36a99bcf-5994-409e-b5fe-eaa7b1d8df87 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:32.025805 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-36a99bcf-5994-409e-b5fe-eaa7b1d8df87 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:32.035287 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-36a99bcf-5994-409e-b5fe-eaa7b1d8df87 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:32.035822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-36a99bcf-5994-409e-b5fe-eaa7b1d8df87 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:32.035931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-21eea949-3a17-44f9-8763-bfdef1af5d82 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:32.036636 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-36a99bcf-5994-409e-b5fe-eaa7b1d8df87 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:32.037071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-36a99bcf-5994-409e-b5fe-eaa7b1d8df87 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:32.043767 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-21eea949-3a17-44f9-8763-bfdef1af5d82 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.217912 Aug 04 13:59:32.044500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 264/547] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:31 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:32.049124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-ae3c5782-ba4e-4c01-bbb9-598c7259accc req-bf6e7958-a134-4166-ad58-aa6b236d5622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b58917f-f9cf-44fc-9710-66a328803d79", "name": "network-vif-plugged", "status": "completed", "tag": "83f9b0c4-dded-4107-9f3a-6d8a68ac1f41"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:32.050709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:59:32.050709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 13:59:32.058433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ae3c5782-ba4e-4c01-bbb9-598c7259accc req-bf6e7958-a134-4166-ad58-aa6b236d5622 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:32.058837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ae3c5782-ba4e-4c01-bbb9-598c7259accc req-bf6e7958-a134-4166-ad58-aa6b236d5622 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:32.072666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-ae3c5782-ba4e-4c01-bbb9-598c7259accc req-bf6e7958-a134-4166-ad58-aa6b236d5622 service nova] Creating event network-vif-plugged:83f9b0c4-dded-4107-9f3a-6d8a68ac1f41 for instance 6b58917f-f9cf-44fc-9710-66a328803d79 on hv-cinder-79264 Aug 04 13:59:32.078400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-ae3c5782-ba4e-4c01-bbb9-598c7259accc req-bf6e7958-a134-4166-ad58-aa6b236d5622 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032697 Aug 04 13:59:32.079012 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 265/548] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:59:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:32.174480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-36a99bcf-5994-409e-b5fe-eaa7b1d8df87 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:32.184921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-36a99bcf-5994-409e-b5fe-eaa7b1d8df87 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.163391 Aug 04 13:59:32.185688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 284/549] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:32 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:32.817722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-94b77945-71d5-4206-a718-affc54aad992 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:32.819370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-94b77945-71d5-4206-a718-affc54aad992 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:32.828901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-94b77945-71d5-4206-a718-affc54aad992 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:32.829540 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-94b77945-71d5-4206-a718-affc54aad992 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:32.830199 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-94b77945-71d5-4206-a718-affc54aad992 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:32.830685 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-94b77945-71d5-4206-a718-affc54aad992 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:32.837580 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b84de1e5-7610-47c2-bb13-85de67364106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:32.838752 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b84de1e5-7610-47c2-bb13-85de67364106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:32.846271 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b84de1e5-7610-47c2-bb13-85de67364106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:32.846719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b84de1e5-7610-47c2-bb13-85de67364106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:32.847499 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b84de1e5-7610-47c2-bb13-85de67364106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:32.847953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b84de1e5-7610-47c2-bb13-85de67364106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:33.474864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b84de1e5-7610-47c2-bb13-85de67364106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.640981 Aug 04 13:59:33.476049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 285/550] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:32 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:33.483130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-432a3d71-2c0c-4b51-a736-67b067521358 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:33.484466 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-432a3d71-2c0c-4b51-a736-67b067521358 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:33.492287 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-432a3d71-2c0c-4b51-a736-67b067521358 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:33.492740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-432a3d71-2c0c-4b51-a736-67b067521358 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:33.493523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-432a3d71-2c0c-4b51-a736-67b067521358 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:33.493957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-432a3d71-2c0c-4b51-a736-67b067521358 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:33.569744 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-94b77945-71d5-4206-a718-affc54aad992 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.758463 Aug 04 13:59:33.572889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 266/551] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:32 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:33.584580 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7e5f1e76-3ad7-4ca7-a5f4-d9f3c0256225 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:33.586094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7e5f1e76-3ad7-4ca7-a5f4-d9f3c0256225 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:33.595296 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7e5f1e76-3ad7-4ca7-a5f4-d9f3c0256225 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:33.595748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7e5f1e76-3ad7-4ca7-a5f4-d9f3c0256225 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:33.596660 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7e5f1e76-3ad7-4ca7-a5f4-d9f3c0256225 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:33.597690 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7e5f1e76-3ad7-4ca7-a5f4-d9f3c0256225 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:33.631059 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-432a3d71-2c0c-4b51-a736-67b067521358 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:33.639568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-432a3d71-2c0c-4b51-a736-67b067521358 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.160913 Aug 04 13:59:33.640279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 286/552] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:33 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:33.645186 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-990e4215-2d5d-4269-9970-2020f57672eb tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:33.645874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-990e4215-2d5d-4269-9970-2020f57672eb tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:33.651908 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-990e4215-2d5d-4269-9970-2020f57672eb tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:33.652429 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-990e4215-2d5d-4269-9970-2020f57672eb tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:33.653211 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-990e4215-2d5d-4269-9970-2020f57672eb tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:33.653640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-990e4215-2d5d-4269-9970-2020f57672eb tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:33.776396 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7e5f1e76-3ad7-4ca7-a5f4-d9f3c0256225 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:33.784659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7e5f1e76-3ad7-4ca7-a5f4-d9f3c0256225 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.209521 Aug 04 13:59:33.785320 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 267/553] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:33 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:33.863664 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-990e4215-2d5d-4269-9970-2020f57672eb tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:33.878930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-990e4215-2d5d-4269-9970-2020f57672eb tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.236784 Aug 04 13:59:33.879577 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 287/554] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:33 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:34.492746 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e92121fe-7f67-437f-b825-fdc42f9af3c7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:34.494285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e92121fe-7f67-437f-b825-fdc42f9af3c7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:34.501541 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e92121fe-7f67-437f-b825-fdc42f9af3c7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:34.501990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e92121fe-7f67-437f-b825-fdc42f9af3c7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:34.502780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e92121fe-7f67-437f-b825-fdc42f9af3c7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:34.503206 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e92121fe-7f67-437f-b825-fdc42f9af3c7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:34.583904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3a366b06-a0ce-48aa-8ef5-05c4c6ed9a0f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:34.584845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3a366b06-a0ce-48aa-8ef5-05c4c6ed9a0f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:34.591338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a366b06-a0ce-48aa-8ef5-05c4c6ed9a0f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:34.591780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a366b06-a0ce-48aa-8ef5-05c4c6ed9a0f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:34.592635 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a366b06-a0ce-48aa-8ef5-05c4c6ed9a0f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:34.593060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a366b06-a0ce-48aa-8ef5-05c4c6ed9a0f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:34.801305 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e92121fe-7f67-437f-b825-fdc42f9af3c7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.315470 Aug 04 13:59:34.802085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 268/555] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:34 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:34.808304 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d5e83ed8-e273-4528-a719-46806fbe46e0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:34.808975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d5e83ed8-e273-4528-a719-46806fbe46e0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:34.815834 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5e83ed8-e273-4528-a719-46806fbe46e0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:34.816282 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5e83ed8-e273-4528-a719-46806fbe46e0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:34.817064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5e83ed8-e273-4528-a719-46806fbe46e0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:34.817495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5e83ed8-e273-4528-a719-46806fbe46e0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:34.845482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3a366b06-a0ce-48aa-8ef5-05c4c6ed9a0f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.265614 Aug 04 13:59:34.850404 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 288/556] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:34 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:34.855816 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a72a98b6-02d0-4dda-aa03-e8b16b4246d9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:34.856695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a72a98b6-02d0-4dda-aa03-e8b16b4246d9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:34.864613 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a72a98b6-02d0-4dda-aa03-e8b16b4246d9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:34.865890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a72a98b6-02d0-4dda-aa03-e8b16b4246d9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:34.866905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a72a98b6-02d0-4dda-aa03-e8b16b4246d9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:34.867579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a72a98b6-02d0-4dda-aa03-e8b16b4246d9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:35.021616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d5e83ed8-e273-4528-a719-46806fbe46e0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:35.033679 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d5e83ed8-e273-4528-a719-46806fbe46e0 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.229623 Aug 04 13:59:35.035076 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 269/557] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:34 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:35.035898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a72a98b6-02d0-4dda-aa03-e8b16b4246d9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:35.043209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b9e802bd-c656-4198-b339-3de3bb7c4bb1 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:35.044423 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b9e802bd-c656-4198-b339-3de3bb7c4bb1 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:35.049496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a72a98b6-02d0-4dda-aa03-e8b16b4246d9 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1318 microversion: 2.1 time: 0.197448 Aug 04 13:59:35.050604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 289/558] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:34 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:35.059611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b9e802bd-c656-4198-b339-3de3bb7c4bb1 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:35.059611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b9e802bd-c656-4198-b339-3de3bb7c4bb1 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:35.059611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b9e802bd-c656-4198-b339-3de3bb7c4bb1 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:35.059611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b9e802bd-c656-4198-b339-3de3bb7c4bb1 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:35.312647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b9e802bd-c656-4198-b339-3de3bb7c4bb1 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:35.320471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b9e802bd-c656-4198-b339-3de3bb7c4bb1 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.283397 Aug 04 13:59:35.321082 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 270/559] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:35 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:35.819273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f16456d0-b77a-45d1-9225-4ac6ca2da37b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:35.821455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f16456d0-b77a-45d1-9225-4ac6ca2da37b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:35.831092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f16456d0-b77a-45d1-9225-4ac6ca2da37b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:35.832047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f16456d0-b77a-45d1-9225-4ac6ca2da37b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:35.833159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f16456d0-b77a-45d1-9225-4ac6ca2da37b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:35.834022 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f16456d0-b77a-45d1-9225-4ac6ca2da37b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:35.858279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5fa45a2f-a8e2-4baf-8f36-c0740a8844de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:35.860801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5fa45a2f-a8e2-4baf-8f36-c0740a8844de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:35.870016 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5fa45a2f-a8e2-4baf-8f36-c0740a8844de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:35.870670 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5fa45a2f-a8e2-4baf-8f36-c0740a8844de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:35.871737 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5fa45a2f-a8e2-4baf-8f36-c0740a8844de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:35.872476 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5fa45a2f-a8e2-4baf-8f36-c0740a8844de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:36.031827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f16456d0-b77a-45d1-9225-4ac6ca2da37b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.220358 Aug 04 13:59:36.032976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 290/560] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:35 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:36.041661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-1eab47dc-56e0-4bca-ae1d-6737e6935b04 req-14b18808-0f7c-4294-98f5-ab2775cf0b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551b4b1-d7e9-49f9-9516-e0c6538d764a", "name": "network-vif-plugged", "status": "completed", "tag": "75707259-ef90-4e88-b098-74e592e529be"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:36.043711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:59:36.043711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:59:36.053295 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-1eab47dc-56e0-4bca-ae1d-6737e6935b04 req-14b18808-0f7c-4294-98f5-ab2775cf0b2f service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:36.053998 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-1eab47dc-56e0-4bca-ae1d-6737e6935b04 req-14b18808-0f7c-4294-98f5-ab2775cf0b2f service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:36.067290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-1eab47dc-56e0-4bca-ae1d-6737e6935b04 req-14b18808-0f7c-4294-98f5-ab2775cf0b2f service nova] Creating event network-vif-plugged:75707259-ef90-4e88-b098-74e592e529be for instance a551b4b1-d7e9-49f9-9516-e0c6538d764a on hv-cinder-79264 Aug 04 13:59:36.072376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-1eab47dc-56e0-4bca-ae1d-6737e6935b04 req-14b18808-0f7c-4294-98f5-ab2775cf0b2f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037316 Aug 04 13:59:36.073403 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 291/561] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:59:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:36.082425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5951f44c-1a68-4a4a-a441-b4feaccd3cff tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:36.084107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5951f44c-1a68-4a4a-a441-b4feaccd3cff tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:36.092206 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5fa45a2f-a8e2-4baf-8f36-c0740a8844de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.237846 Aug 04 13:59:36.093825 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 271/562] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:35 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:36.095334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5951f44c-1a68-4a4a-a441-b4feaccd3cff tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:36.096138 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5951f44c-1a68-4a4a-a441-b4feaccd3cff tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:36.097532 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5951f44c-1a68-4a4a-a441-b4feaccd3cff tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:36.098530 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5951f44c-1a68-4a4a-a441-b4feaccd3cff tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:36.099286 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9c2f8550-cf22-4cde-bd35-d3e1dec7acd4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:36.099976 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9c2f8550-cf22-4cde-bd35-d3e1dec7acd4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:36.106950 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c2f8550-cf22-4cde-bd35-d3e1dec7acd4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:36.108346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c2f8550-cf22-4cde-bd35-d3e1dec7acd4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:36.109323 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c2f8550-cf22-4cde-bd35-d3e1dec7acd4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:36.109759 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9c2f8550-cf22-4cde-bd35-d3e1dec7acd4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:36.253502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9c2f8550-cf22-4cde-bd35-d3e1dec7acd4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:36.254515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5951f44c-1a68-4a4a-a441-b4feaccd3cff tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:36.263071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9c2f8550-cf22-4cde-bd35-d3e1dec7acd4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1509 microversion: 2.1 time: 0.167583 Aug 04 13:59:36.263287 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5951f44c-1a68-4a4a-a441-b4feaccd3cff tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.188014 Aug 04 13:59:36.263650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 272/563] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:36 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:36.274085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 292/564] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:36 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:36.338641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cc21ca88-fe79-4fb1-ba99-782fa62565fc tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:36.339638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cc21ca88-fe79-4fb1-ba99-782fa62565fc tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:36.347036 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cc21ca88-fe79-4fb1-ba99-782fa62565fc tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:36.347568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cc21ca88-fe79-4fb1-ba99-782fa62565fc tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:36.348579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cc21ca88-fe79-4fb1-ba99-782fa62565fc tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:36.349009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cc21ca88-fe79-4fb1-ba99-782fa62565fc tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:36.507986 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cc21ca88-fe79-4fb1-ba99-782fa62565fc tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:36.525260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cc21ca88-fe79-4fb1-ba99-782fa62565fc tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.189775 Aug 04 13:59:36.526311 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 273/565] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:36 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:37.044842 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7ca4b532-167e-4a95-a53e-47a2078dfeb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:37.046678 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7ca4b532-167e-4a95-a53e-47a2078dfeb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:37.053618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7ca4b532-167e-4a95-a53e-47a2078dfeb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.054056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7ca4b532-167e-4a95-a53e-47a2078dfeb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.054827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7ca4b532-167e-4a95-a53e-47a2078dfeb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.055251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7ca4b532-167e-4a95-a53e-47a2078dfeb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.105097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e6c8e7f3-43ac-4072-853b-6f2f62315792 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:37.106176 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e6c8e7f3-43ac-4072-853b-6f2f62315792 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:37.113441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6c8e7f3-43ac-4072-853b-6f2f62315792 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.113879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6c8e7f3-43ac-4072-853b-6f2f62315792 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.114662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6c8e7f3-43ac-4072-853b-6f2f62315792 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.115093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6c8e7f3-43ac-4072-853b-6f2f62315792 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.167175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7ca4b532-167e-4a95-a53e-47a2078dfeb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.126883 Aug 04 13:59:37.172298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 293/566] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:37 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:37.269147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e6c8e7f3-43ac-4072-853b-6f2f62315792 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.167638 Aug 04 13:59:37.269821 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 274/567] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:37 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:37.281019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2ee7570c-256c-4e32-9fc3-1cd682801773 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:37.281643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2ee7570c-256c-4e32-9fc3-1cd682801773 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:37.288935 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ee7570c-256c-4e32-9fc3-1cd682801773 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.289377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ee7570c-256c-4e32-9fc3-1cd682801773 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.290145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ee7570c-256c-4e32-9fc3-1cd682801773 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.290595 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ee7570c-256c-4e32-9fc3-1cd682801773 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.413089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2ee7570c-256c-4e32-9fc3-1cd682801773 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:37.420256 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2ee7570c-256c-4e32-9fc3-1cd682801773 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.143374 Aug 04 13:59:37.420822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 294/568] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:37 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:37.549105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b3024420-2a56-4a4d-af44-4029512592f5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:37.549699 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b3024420-2a56-4a4d-af44-4029512592f5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:37.556389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3024420-2a56-4a4d-af44-4029512592f5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.556829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3024420-2a56-4a4d-af44-4029512592f5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.557595 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3024420-2a56-4a4d-af44-4029512592f5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.558239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3024420-2a56-4a4d-af44-4029512592f5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.645094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f7f0c26b-8e5e-47d0-8428-39806ee6e2ad tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f42b9efd-43fe-4782-8a96-7f31bafbd7b8"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:37.647254 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f7f0c26b-8e5e-47d0-8428-39806ee6e2ad tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:37.654367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f7f0c26b-8e5e-47d0-8428-39806ee6e2ad tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.655414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f7f0c26b-8e5e-47d0-8428-39806ee6e2ad tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.656385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f7f0c26b-8e5e-47d0-8428-39806ee6e2ad tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:37.656765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f7f0c26b-8e5e-47d0-8428-39806ee6e2ad tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:37.707643 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b3024420-2a56-4a4d-af44-4029512592f5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:37.715486 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b3024420-2a56-4a4d-af44-4029512592f5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.171024 Aug 04 13:59:37.719805 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 275/569] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:37 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:38.180397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-dc1ca4a7-649c-46c0-8fd9-bd8c7588c210 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:38.181298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-dc1ca4a7-649c-46c0-8fd9-bd8c7588c210 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:38.189835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc1ca4a7-649c-46c0-8fd9-bd8c7588c210 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.190277 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc1ca4a7-649c-46c0-8fd9-bd8c7588c210 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.191076 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc1ca4a7-649c-46c0-8fd9-bd8c7588c210 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.191503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc1ca4a7-649c-46c0-8fd9-bd8c7588c210 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.512122 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-dc1ca4a7-649c-46c0-8fd9-bd8c7588c210 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.335299 Aug 04 13:59:38.517190 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 276/570] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:38 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:59:38.519011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-559552a6-632f-4d62-9bb3-f531cd5ed9fe tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:38.520004 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-559552a6-632f-4d62-9bb3-f531cd5ed9fe tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:38.527513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-559552a6-632f-4d62-9bb3-f531cd5ed9fe tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.528150 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-559552a6-632f-4d62-9bb3-f531cd5ed9fe tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.529020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-559552a6-632f-4d62-9bb3-f531cd5ed9fe tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.529587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-559552a6-632f-4d62-9bb3-f531cd5ed9fe tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.590915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f7f0c26b-8e5e-47d0-8428-39806ee6e2ad tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949596 Aug 04 13:59:38.596641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 295/571] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 13:59:37 2021] POST /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79/os-volume_attachments => generated 194 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:59:38.596641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-db5cd04b-4dd1-464a-bec7-81283adc78eb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:38.597204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-db5cd04b-4dd1-464a-bec7-81283adc78eb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:38.603388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-db5cd04b-4dd1-464a-bec7-81283adc78eb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.603833 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-db5cd04b-4dd1-464a-bec7-81283adc78eb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.604701 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-db5cd04b-4dd1-464a-bec7-81283adc78eb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.605135 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-db5cd04b-4dd1-464a-bec7-81283adc78eb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.727221 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-db5cd04b-4dd1-464a-bec7-81283adc78eb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:38.734895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-db5cd04b-4dd1-464a-bec7-81283adc78eb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1501 microversion: 2.1 time: 0.142030 Aug 04 13:59:38.735394 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 296/572] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:38 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1501 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:38.739698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5aa1d249-13b9-40d0-a876-2f63481c4734 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:38.740312 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5aa1d249-13b9-40d0-a876-2f63481c4734 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:38.746033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5aa1d249-13b9-40d0-a876-2f63481c4734 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.746470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5aa1d249-13b9-40d0-a876-2f63481c4734 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.747225 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5aa1d249-13b9-40d0-a876-2f63481c4734 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.747728 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5aa1d249-13b9-40d0-a876-2f63481c4734 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.877751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5aa1d249-13b9-40d0-a876-2f63481c4734 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:38.885066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5aa1d249-13b9-40d0-a876-2f63481c4734 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.148718 Aug 04 13:59:38.885630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 297/573] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:38 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:38.890368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdfa82c9-5a62-4ae7-812d-f32ff95792f2"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:38.891568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:38.897524 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.897964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.898867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.899457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.924755 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] HTTP exception thrown: Cannot 'attach_volume' instance 7ee769da-062a-4fe8-bd70-3dce1f031665 while it is in vm_state rescued Aug 04 13:59:38.925340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Returning 409 to user: Cannot 'attach_volume' instance 7ee769da-062a-4fe8-bd70-3dce1f031665 while it is in vm_state rescued {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:59:38.926176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ea55d2c1-3d79-42c2-9593-8f31cc764d91 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039634 Aug 04 13:59:38.926735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 298/574] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 13:59:38 2021] POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:59:38.935406 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-28300ea5-6159-41fb-8321-3738248380db tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:38.936768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-28300ea5-6159-41fb-8321-3738248380db tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:38.946124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28300ea5-6159-41fb-8321-3738248380db tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.946124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28300ea5-6159-41fb-8321-3738248380db tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:38.946124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28300ea5-6159-41fb-8321-3738248380db tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:38.946124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28300ea5-6159-41fb-8321-3738248380db tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:39.243916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-28300ea5-6159-41fb-8321-3738248380db tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/action" status: 202 len: 0 microversion: 2.1 time: 0.312041 Aug 04 13:59:39.247821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 299/575] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:38 2021] POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:39.253859 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-58d5fbfe-3dfc-473f-897f-80e372d0c79f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:39.254542 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-58d5fbfe-3dfc-473f-897f-80e372d0c79f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:39.260911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58d5fbfe-3dfc-473f-897f-80e372d0c79f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:39.261402 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58d5fbfe-3dfc-473f-897f-80e372d0c79f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:39.262173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58d5fbfe-3dfc-473f-897f-80e372d0c79f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:39.262599 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58d5fbfe-3dfc-473f-897f-80e372d0c79f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:39.403508 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-58d5fbfe-3dfc-473f-897f-80e372d0c79f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:39.413016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-58d5fbfe-3dfc-473f-897f-80e372d0c79f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1509 microversion: 2.1 time: 0.163234 Aug 04 13:59:39.413715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 300/576] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:39 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:39.524993 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b5da288d-88b5-4528-a637-e2dcc40f2a80 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:39.525855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b5da288d-88b5-4528-a637-e2dcc40f2a80 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:39.532862 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b5da288d-88b5-4528-a637-e2dcc40f2a80 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:39.533299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b5da288d-88b5-4528-a637-e2dcc40f2a80 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:39.534063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b5da288d-88b5-4528-a637-e2dcc40f2a80 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:39.534570 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b5da288d-88b5-4528-a637-e2dcc40f2a80 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:42.202621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-559552a6-632f-4d62-9bb3-f531cd5ed9fe tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 3.686625 Aug 04 13:59:42.203523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 277/577] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:38 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 3690 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:42.209795 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6720f198-2c63-4cff-99df-b10c61b29cbf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:42.210501 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6720f198-2c63-4cff-99df-b10c61b29cbf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:42.218746 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6720f198-2c63-4cff-99df-b10c61b29cbf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:42.219074 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6720f198-2c63-4cff-99df-b10c61b29cbf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:42.219876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6720f198-2c63-4cff-99df-b10c61b29cbf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:42.220435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6720f198-2c63-4cff-99df-b10c61b29cbf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:42.230197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b5da288d-88b5-4528-a637-e2dcc40f2a80 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 2.708248 Aug 04 13:59:42.235819 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 301/578] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:39 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 2711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:59:42.242076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-97ec4255-6b35-4ff2-8c44-edfbae304594 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:42.243555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-97ec4255-6b35-4ff2-8c44-edfbae304594 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:42.255890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97ec4255-6b35-4ff2-8c44-edfbae304594 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:42.256863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97ec4255-6b35-4ff2-8c44-edfbae304594 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:42.258382 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97ec4255-6b35-4ff2-8c44-edfbae304594 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:42.259346 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97ec4255-6b35-4ff2-8c44-edfbae304594 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:42.486589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6720f198-2c63-4cff-99df-b10c61b29cbf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:42.495373 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6720f198-2c63-4cff-99df-b10c61b29cbf tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1314 microversion: 2.1 time: 0.290622 Aug 04 13:59:42.499820 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 278/579] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:42 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:42.608131 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-97ec4255-6b35-4ff2-8c44-edfbae304594 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:42.616193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-97ec4255-6b35-4ff2-8c44-edfbae304594 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1509 microversion: 2.1 time: 0.382091 Aug 04 13:59:42.616783 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 302/580] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:42 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:43.218518 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3fd7481d-a1d6-4ea4-aefa-cd9c89348240 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:43.220081 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3fd7481d-a1d6-4ea4-aefa-cd9c89348240 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:43.228017 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3fd7481d-a1d6-4ea4-aefa-cd9c89348240 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.228587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3fd7481d-a1d6-4ea4-aefa-cd9c89348240 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.229714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3fd7481d-a1d6-4ea4-aefa-cd9c89348240 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.230419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3fd7481d-a1d6-4ea4-aefa-cd9c89348240 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.244913 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7943fdd7-64d7-4095-8f3a-7865b0735d05 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:43.245928 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7943fdd7-64d7-4095-8f3a-7865b0735d05 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:43.252643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7943fdd7-64d7-4095-8f3a-7865b0735d05 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.253194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7943fdd7-64d7-4095-8f3a-7865b0735d05 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.253996 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7943fdd7-64d7-4095-8f3a-7865b0735d05 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.254436 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7943fdd7-64d7-4095-8f3a-7865b0735d05 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.495751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3fd7481d-a1d6-4ea4-aefa-cd9c89348240 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.281450 Aug 04 13:59:43.498637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 279/581] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:43 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:43.512043 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7943fdd7-64d7-4095-8f3a-7865b0735d05 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.271163 Aug 04 13:59:43.514284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 303/582] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:43 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:59:43.520419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a231b2e0-0365-4ee1-85e1-13060d5d404d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:43.521312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a231b2e0-0365-4ee1-85e1-13060d5d404d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:43.530355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a231b2e0-0365-4ee1-85e1-13060d5d404d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.531148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a231b2e0-0365-4ee1-85e1-13060d5d404d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.532207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a231b2e0-0365-4ee1-85e1-13060d5d404d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.532867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a231b2e0-0365-4ee1-85e1-13060d5d404d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.642777 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-56e74d2d-4d85-42ce-8ab2-95e75bba4cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:43.643652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-56e74d2d-4d85-42ce-8ab2-95e75bba4cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:43.652404 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56e74d2d-4d85-42ce-8ab2-95e75bba4cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.653215 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56e74d2d-4d85-42ce-8ab2-95e75bba4cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.654619 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56e74d2d-4d85-42ce-8ab2-95e75bba4cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.655088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56e74d2d-4d85-42ce-8ab2-95e75bba4cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.688502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a231b2e0-0365-4ee1-85e1-13060d5d404d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:43.696507 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a231b2e0-0365-4ee1-85e1-13060d5d404d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1463 microversion: 2.1 time: 0.182653 Aug 04 13:59:43.698160 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 280/583] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:43 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:43.742435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-92548fbd-4885-4143-84d9-37a6db7216b5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:43.743032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-92548fbd-4885-4143-84d9-37a6db7216b5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:43.756742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92548fbd-4885-4143-84d9-37a6db7216b5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.757439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92548fbd-4885-4143-84d9-37a6db7216b5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.759268 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92548fbd-4885-4143-84d9-37a6db7216b5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.759962 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92548fbd-4885-4143-84d9-37a6db7216b5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.802881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-92548fbd-4885-4143-84d9-37a6db7216b5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 13:59:43.856743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-56e74d2d-4d85-42ce-8ab2-95e75bba4cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:43.865966 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-56e74d2d-4d85-42ce-8ab2-95e75bba4cf5 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1509 microversion: 2.1 time: 0.230050 Aug 04 13:59:43.866856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 304/584] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:43 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:43.900137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-92548fbd-4885-4143-84d9-37a6db7216b5 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 204 len: 0 microversion: 2.1 time: 0.166611 Aug 04 13:59:43.900666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 281/585] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 13:59:43 2021] DELETE /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:59:43.909586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-676e56d5-bdca-479c-bfcb-db0222bc356d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:43.910198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-676e56d5-bdca-479c-bfcb-db0222bc356d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:43.916622 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-676e56d5-bdca-479c-bfcb-db0222bc356d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.917068 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-676e56d5-bdca-479c-bfcb-db0222bc356d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:43.917848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-676e56d5-bdca-479c-bfcb-db0222bc356d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:43.918283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-676e56d5-bdca-479c-bfcb-db0222bc356d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:44.047467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-676e56d5-bdca-479c-bfcb-db0222bc356d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:44.057405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-676e56d5-bdca-479c-bfcb-db0222bc356d tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1469 microversion: 2.1 time: 0.151431 Aug 04 13:59:44.058052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 305/586] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:43 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:44.510198 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3699a78c-0ac0-4943-81ad-2f0dba9a0de8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:44.511275 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3699a78c-0ac0-4943-81ad-2f0dba9a0de8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:44.517503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3699a78c-0ac0-4943-81ad-2f0dba9a0de8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:44.517954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3699a78c-0ac0-4943-81ad-2f0dba9a0de8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:44.518732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3699a78c-0ac0-4943-81ad-2f0dba9a0de8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:44.519163 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3699a78c-0ac0-4943-81ad-2f0dba9a0de8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:44.526524 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-57a34d62-1652-4b39-a360-4fe27855c08c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:44.527494 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-57a34d62-1652-4b39-a360-4fe27855c08c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:44.534441 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-57a34d62-1652-4b39-a360-4fe27855c08c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:44.534837 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-57a34d62-1652-4b39-a360-4fe27855c08c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:44.535616 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-57a34d62-1652-4b39-a360-4fe27855c08c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:44.536042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-57a34d62-1652-4b39-a360-4fe27855c08c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:44.652151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3699a78c-0ac0-4943-81ad-2f0dba9a0de8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.145900 Aug 04 13:59:44.652771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 282/587] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:44 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:44.665223 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-57a34d62-1652-4b39-a360-4fe27855c08c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.142256 Aug 04 13:59:44.667433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 306/588] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:44 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:59:44.887157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f7cfbefe-f5c4-4f3c-acf9-20b02cbdf332 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:44.887859 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f7cfbefe-f5c4-4f3c-acf9-20b02cbdf332 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:44.895029 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f7cfbefe-f5c4-4f3c-acf9-20b02cbdf332 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:44.895607 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f7cfbefe-f5c4-4f3c-acf9-20b02cbdf332 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:44.896292 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f7cfbefe-f5c4-4f3c-acf9-20b02cbdf332 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:44.896733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f7cfbefe-f5c4-4f3c-acf9-20b02cbdf332 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:45.055061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f7cfbefe-f5c4-4f3c-acf9-20b02cbdf332 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:45.067916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f7cfbefe-f5c4-4f3c-acf9-20b02cbdf332 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1509 microversion: 2.1 time: 0.184609 Aug 04 13:59:45.069094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 283/589] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:44 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:45.081405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fcd25be7-bbae-43cd-8da4-2c42e126ac6c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:45.082314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fcd25be7-bbae-43cd-8da4-2c42e126ac6c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:45.089988 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcd25be7-bbae-43cd-8da4-2c42e126ac6c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:45.090508 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcd25be7-bbae-43cd-8da4-2c42e126ac6c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:45.091350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcd25be7-bbae-43cd-8da4-2c42e126ac6c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:45.091942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcd25be7-bbae-43cd-8da4-2c42e126ac6c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:45.240597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fcd25be7-bbae-43cd-8da4-2c42e126ac6c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:45.248618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fcd25be7-bbae-43cd-8da4-2c42e126ac6c tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1469 microversion: 2.1 time: 0.172587 Aug 04 13:59:45.249199 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 307/590] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:45 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:45.664693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8c4c37ec-68c8-481c-bdd8-97a1c29ece19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:45.665660 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8c4c37ec-68c8-481c-bdd8-97a1c29ece19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:45.673046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c4c37ec-68c8-481c-bdd8-97a1c29ece19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:45.673495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c4c37ec-68c8-481c-bdd8-97a1c29ece19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:45.674745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c4c37ec-68c8-481c-bdd8-97a1c29ece19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:45.675512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c4c37ec-68c8-481c-bdd8-97a1c29ece19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:45.678718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b8f121f5-7cf1-4eff-81a5-b8474d96625e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:45.679707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b8f121f5-7cf1-4eff-81a5-b8474d96625e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:45.687904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8f121f5-7cf1-4eff-81a5-b8474d96625e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:45.695440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8f121f5-7cf1-4eff-81a5-b8474d96625e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:45.695440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8f121f5-7cf1-4eff-81a5-b8474d96625e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:45.695440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8f121f5-7cf1-4eff-81a5-b8474d96625e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:45.954302 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b8f121f5-7cf1-4eff-81a5-b8474d96625e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.279520 Aug 04 13:59:45.954964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 308/591] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:45 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:59:45.971680 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8c4c37ec-68c8-481c-bdd8-97a1c29ece19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.310212 Aug 04 13:59:45.973041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 284/592] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:45 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:46.093052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-01a83ea4-b595-4656-b6c0-ba508321dada tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:46.093777 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-01a83ea4-b595-4656-b6c0-ba508321dada tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:46.101230 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-01a83ea4-b595-4656-b6c0-ba508321dada tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.102092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-01a83ea4-b595-4656-b6c0-ba508321dada tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:46.103036 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-01a83ea4-b595-4656-b6c0-ba508321dada tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.103671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-01a83ea4-b595-4656-b6c0-ba508321dada tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:46.266136 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-be6bf0c6-fbb7-41bb-991d-b388c7e6f2ce tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:46.266758 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-be6bf0c6-fbb7-41bb-991d-b388c7e6f2ce tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:46.274435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-be6bf0c6-fbb7-41bb-991d-b388c7e6f2ce tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.274916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-be6bf0c6-fbb7-41bb-991d-b388c7e6f2ce tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:46.275784 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-be6bf0c6-fbb7-41bb-991d-b388c7e6f2ce tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.276358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-be6bf0c6-fbb7-41bb-991d-b388c7e6f2ce tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:46.340102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-01a83ea4-b595-4656-b6c0-ba508321dada tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:46.351896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-01a83ea4-b595-4656-b6c0-ba508321dada tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1509 microversion: 2.1 time: 0.267230 Aug 04 13:59:46.352606 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 309/593] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:46 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:46.435451 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-be6bf0c6-fbb7-41bb-991d-b388c7e6f2ce tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:46.452930 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-be6bf0c6-fbb7-41bb-991d-b388c7e6f2ce tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1469 microversion: 2.1 time: 0.191030 Aug 04 13:59:46.453619 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 285/594] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:46 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1469 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:46.774744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-ee23108c-b7c9-4a8a-b2c6-f72a21dea92b req-70611312-56fb-40f5-808d-9a4c1bba5b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551b4b1-d7e9-49f9-9516-e0c6538d764a", "name": "network-vif-deleted", "tag": "75707259-ef90-4e88-b098-74e592e529be"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:46.776552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:59:46.776552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 13:59:46.784807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-ee23108c-b7c9-4a8a-b2c6-f72a21dea92b req-70611312-56fb-40f5-808d-9a4c1bba5b27 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.785247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-ee23108c-b7c9-4a8a-b2c6-f72a21dea92b req-70611312-56fb-40f5-808d-9a4c1bba5b27 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:46.798437 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-ee23108c-b7c9-4a8a-b2c6-f72a21dea92b req-70611312-56fb-40f5-808d-9a4c1bba5b27 service nova] Creating event network-vif-deleted:75707259-ef90-4e88-b098-74e592e529be for instance a551b4b1-d7e9-49f9-9516-e0c6538d764a on hv-cinder-79264 Aug 04 13:59:46.805713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-ee23108c-b7c9-4a8a-b2c6-f72a21dea92b req-70611312-56fb-40f5-808d-9a4c1bba5b27 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034515 Aug 04 13:59:46.805930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 310/595] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 13:59:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:46.967598 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0d412b2b-4473-4660-83d7-95c52a901ce7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:46.968535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0d412b2b-4473-4660-83d7-95c52a901ce7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:46.974388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0d412b2b-4473-4660-83d7-95c52a901ce7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.974780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0d412b2b-4473-4660-83d7-95c52a901ce7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:46.975554 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0d412b2b-4473-4660-83d7-95c52a901ce7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.975980 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0d412b2b-4473-4660-83d7-95c52a901ce7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:46.985020 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8f33a4a4-c2a2-4901-a06e-437e7ab01bbf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:46.986157 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8f33a4a4-c2a2-4901-a06e-437e7ab01bbf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:46.992376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f33a4a4-c2a2-4901-a06e-437e7ab01bbf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.992829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f33a4a4-c2a2-4901-a06e-437e7ab01bbf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:46.993611 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f33a4a4-c2a2-4901-a06e-437e7ab01bbf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:46.994047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f33a4a4-c2a2-4901-a06e-437e7ab01bbf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:47.093904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0d412b2b-4473-4660-83d7-95c52a901ce7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.131050 Aug 04 13:59:47.094984 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 286/596] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:46 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:47.117898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8f33a4a4-c2a2-4901-a06e-437e7ab01bbf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.137137 Aug 04 13:59:47.118701 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 311/597] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:46 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:47.369611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4a86de01-1d50-436a-b6e5-b173cbaee7fd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:47.370047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4a86de01-1d50-436a-b6e5-b173cbaee7fd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:47.378012 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a86de01-1d50-436a-b6e5-b173cbaee7fd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:47.378708 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a86de01-1d50-436a-b6e5-b173cbaee7fd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:47.379509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a86de01-1d50-436a-b6e5-b173cbaee7fd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:47.379947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a86de01-1d50-436a-b6e5-b173cbaee7fd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:47.471945 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:47.472796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:47.479489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:47.480090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:47.481134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:47.481661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:47.510562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4a86de01-1d50-436a-b6e5-b173cbaee7fd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:47.513830 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:47.514452 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:47.515017 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lazy-loading 'fault' on Instance uuid a551b4b1-d7e9-49f9-9516-e0c6538d764a {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:59:47.518531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4a86de01-1d50-436a-b6e5-b173cbaee7fd tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1515 microversion: 2.1 time: 0.153674 Aug 04 13:59:47.528350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 287/598] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:47 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:47.573508 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7028bcd7c499450b81db4c8931be31a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee2ff3dd6d94912a0b3f2ac0ba73ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:47.581743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-edb8a941-dde0-49b1-98f3-07632d122350 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 200 len: 1304 microversion: 2.1 time: 0.113828 Aug 04 13:59:47.582690 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 312/599] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:47 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:48.108748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-90d4c55a-4b3e-4ac8-a61c-d5cbef94bebe tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:48.110159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-90d4c55a-4b3e-4ac8-a61c-d5cbef94bebe tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:48.116909 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90d4c55a-4b3e-4ac8-a61c-d5cbef94bebe tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:48.117360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90d4c55a-4b3e-4ac8-a61c-d5cbef94bebe tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:48.118140 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90d4c55a-4b3e-4ac8-a61c-d5cbef94bebe tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:48.118567 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90d4c55a-4b3e-4ac8-a61c-d5cbef94bebe tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:48.134416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-533d2e0f-989b-4d14-ab1d-5573c84a70d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:48.136004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-533d2e0f-989b-4d14-ab1d-5573c84a70d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:48.144346 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-533d2e0f-989b-4d14-ab1d-5573c84a70d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:48.145197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-533d2e0f-989b-4d14-ab1d-5573c84a70d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:48.146455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-533d2e0f-989b-4d14-ab1d-5573c84a70d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:48.147029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-533d2e0f-989b-4d14-ab1d-5573c84a70d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:48.254957 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-90d4c55a-4b3e-4ac8-a61c-d5cbef94bebe tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.151444 Aug 04 13:59:48.261931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 288/600] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:48 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:48.286419 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-533d2e0f-989b-4d14-ab1d-5573c84a70d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.150203 Aug 04 13:59:48.290924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 313/601] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:48 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:48.601270 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:48.602233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] [instance: a551b4b1-d7e9-49f9-9516-e0c6538d764a] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:48.614148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:48.614808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:48.615993 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:48.616971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:48.640179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] HTTP exception thrown: Instance a551b4b1-d7e9-49f9-9516-e0c6538d764a could not be found. Aug 04 13:59:48.641329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] Returning 404 to user: Instance a551b4b1-d7e9-49f9-9516-e0c6538d764a could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:59:48.642979 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2ee394b9-e95a-47f3-a6c0-b883d0c9e5d6 tempest-VolumesNegativeTest-256632881 tempest-VolumesNegativeTest-256632881-project] 10.222.0.43 "GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a" status: 404 len: 111 microversion: 2.1 time: 0.046869 Aug 04 13:59:48.644405 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 289/602] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:48 2021] GET /compute/v2.1/servers/a551b4b1-d7e9-49f9-9516-e0c6538d764a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:48.911959 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0f935dd0-420e-49a9-89f9-868b616ca9f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:48.912778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0f935dd0-420e-49a9-89f9-868b616ca9f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:48.919187 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0f935dd0-420e-49a9-89f9-868b616ca9f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:48.919624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0f935dd0-420e-49a9-89f9-868b616ca9f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:48.921280 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0f935dd0-420e-49a9-89f9-868b616ca9f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:48.922012 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0f935dd0-420e-49a9-89f9-868b616ca9f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:49.057553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0f935dd0-420e-49a9-89f9-868b616ca9f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:49.067203 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0f935dd0-420e-49a9-89f9-868b616ca9f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1515 microversion: 2.1 time: 0.159163 Aug 04 13:59:49.080036 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 314/603] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 13:59:48 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:59:49.086553 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ab78a1a2-7b48-4ad3-a0d5-0c0c879eb7ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "840e4260-9f46-477d-8034-6ecf378b4614"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:49.087972 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ab78a1a2-7b48-4ad3-a0d5-0c0c879eb7ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:49.094962 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ab78a1a2-7b48-4ad3-a0d5-0c0c879eb7ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:49.095415 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ab78a1a2-7b48-4ad3-a0d5-0c0c879eb7ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:49.096190 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ab78a1a2-7b48-4ad3-a0d5-0c0c879eb7ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:49.096668 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ab78a1a2-7b48-4ad3-a0d5-0c0c879eb7ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:49.269921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-abcb0b65-67bf-4983-9762-a9334c9fbceb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:49.270879 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-abcb0b65-67bf-4983-9762-a9334c9fbceb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:49.276914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abcb0b65-67bf-4983-9762-a9334c9fbceb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:49.277362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abcb0b65-67bf-4983-9762-a9334c9fbceb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:49.278133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abcb0b65-67bf-4983-9762-a9334c9fbceb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:49.278564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abcb0b65-67bf-4983-9762-a9334c9fbceb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:49.415867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-abcb0b65-67bf-4983-9762-a9334c9fbceb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.149148 Aug 04 13:59:49.419853 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 315/604] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:49 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:49.430205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b98a4dae-e02a-4e35-9378-06467a6e40a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:49.431751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b98a4dae-e02a-4e35-9378-06467a6e40a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:49.439648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b98a4dae-e02a-4e35-9378-06467a6e40a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:49.440574 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b98a4dae-e02a-4e35-9378-06467a6e40a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:49.441975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b98a4dae-e02a-4e35-9378-06467a6e40a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:49.442571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b98a4dae-e02a-4e35-9378-06467a6e40a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:49.573926 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b98a4dae-e02a-4e35-9378-06467a6e40a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.151501 Aug 04 13:59:49.575753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 316/605] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:49 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:49.590329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ab78a1a2-7b48-4ad3-a0d5-0c0c879eb7ab tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509824 Aug 04 13:59:49.601307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 290/606] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 13:59:49 2021] POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/os-volume_attachments => generated 194 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:50.431143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-26d4d88f-dd5f-416a-9f39-b00224321088 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:50.432171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-26d4d88f-dd5f-416a-9f39-b00224321088 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:50.439542 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-26d4d88f-dd5f-416a-9f39-b00224321088 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:50.439988 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-26d4d88f-dd5f-416a-9f39-b00224321088 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:50.440836 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-26d4d88f-dd5f-416a-9f39-b00224321088 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:50.441268 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-26d4d88f-dd5f-416a-9f39-b00224321088 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:50.485565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f42b9efd-43fe-4782-8a96-7f31bafbd7b8"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:50.487121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:50.495941 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:50.498370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:50.499253 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:50.499698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:50.563501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-26d4d88f-dd5f-416a-9f39-b00224321088 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.139505 Aug 04 13:59:50.564147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 317/607] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:50 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:50.587954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bad94566-f95d-4a06-bf46-0479820fb22b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:50.589030 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bad94566-f95d-4a06-bf46-0479820fb22b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:50.595515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bad94566-f95d-4a06-bf46-0479820fb22b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:50.595961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bad94566-f95d-4a06-bf46-0479820fb22b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:50.596855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bad94566-f95d-4a06-bf46-0479820fb22b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:50.597291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bad94566-f95d-4a06-bf46-0479820fb22b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:50.691742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] HTTP exception thrown: Invalid volume: volume f42b9efd-43fe-4782-8a96-7f31bafbd7b8 is already attached to instances: 6b58917f-f9cf-44fc-9710-66a328803d79 Aug 04 13:59:50.692495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Returning 400 to user: Invalid volume: volume f42b9efd-43fe-4782-8a96-7f31bafbd7b8 is already attached to instances: 6b58917f-f9cf-44fc-9710-66a328803d79 {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 13:59:50.693386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-78d9f363-780b-47ea-a2f7-f38d7ed149c5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.216048 Aug 04 13:59:50.697442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 291/608] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 13:59:50 2021] POST /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79/os-volume_attachments => generated 174 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 13:59:50.750029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bad94566-f95d-4a06-bf46-0479820fb22b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.166505 Aug 04 13:59:50.750961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 318/609] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:50 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:50.778409 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1110220e-297f-4255-ba11-a166e60cb3be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:50.778904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1110220e-297f-4255-ba11-a166e60cb3be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:50.785050 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1110220e-297f-4255-ba11-a166e60cb3be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:50.785872 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1110220e-297f-4255-ba11-a166e60cb3be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:50.786288 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1110220e-297f-4255-ba11-a166e60cb3be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:50.786898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1110220e-297f-4255-ba11-a166e60cb3be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:50.942109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-1110220e-297f-4255-ba11-a166e60cb3be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lazy-loading 'services' on Instance uuid 6b58917f-f9cf-44fc-9710-66a328803d79 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:59:51.063637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1110220e-297f-4255-ba11-a166e60cb3be tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79/os-volume_attachments/f42b9efd-43fe-4782-8a96-7f31bafbd7b8" status: 202 len: 0 microversion: 2.1 time: 0.288704 Aug 04 13:59:51.064438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 292/610] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 13:59:50 2021] DELETE /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79/os-volume_attachments/f42b9efd-43fe-4782-8a96-7f31bafbd7b8 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:51.577471 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c1cff49a-e538-49dd-8fdf-760eb1af705a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:51.578530 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c1cff49a-e538-49dd-8fdf-760eb1af705a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:51.585294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c1cff49a-e538-49dd-8fdf-760eb1af705a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:51.585742 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c1cff49a-e538-49dd-8fdf-760eb1af705a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:51.586522 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c1cff49a-e538-49dd-8fdf-760eb1af705a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:51.586955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c1cff49a-e538-49dd-8fdf-760eb1af705a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:51.688944 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c1cff49a-e538-49dd-8fdf-760eb1af705a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.115713 Aug 04 13:59:51.689641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 319/611] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:51 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:51.766993 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-be987669-791f-4e86-a707-2e574eb9c636 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:51.769849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-be987669-791f-4e86-a707-2e574eb9c636 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:51.779867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-be987669-791f-4e86-a707-2e574eb9c636 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:51.780851 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-be987669-791f-4e86-a707-2e574eb9c636 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:51.781722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-be987669-791f-4e86-a707-2e574eb9c636 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:51.782587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-be987669-791f-4e86-a707-2e574eb9c636 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:51.901031 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-be987669-791f-4e86-a707-2e574eb9c636 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.142251 Aug 04 13:59:51.901749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 293/612] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:51 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:52.703720 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ff3c83ea-23b4-4fc5-9a5d-57b70f0f87c9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:52.705016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ff3c83ea-23b4-4fc5-9a5d-57b70f0f87c9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:52.713693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff3c83ea-23b4-4fc5-9a5d-57b70f0f87c9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:52.714247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff3c83ea-23b4-4fc5-9a5d-57b70f0f87c9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:52.715249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff3c83ea-23b4-4fc5-9a5d-57b70f0f87c9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:52.715759 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff3c83ea-23b4-4fc5-9a5d-57b70f0f87c9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:52.825370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ff3c83ea-23b4-4fc5-9a5d-57b70f0f87c9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.127092 Aug 04 13:59:52.826095 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 320/613] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:52 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:52.916035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9d870cb6-7a9c-42bc-acce-ce4f6c9ced14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:52.917308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9d870cb6-7a9c-42bc-acce-ce4f6c9ced14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:52.926094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d870cb6-7a9c-42bc-acce-ce4f6c9ced14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:52.926659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d870cb6-7a9c-42bc-acce-ce4f6c9ced14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:52.927560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d870cb6-7a9c-42bc-acce-ce4f6c9ced14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:52.928105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d870cb6-7a9c-42bc-acce-ce4f6c9ced14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:53.039358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9d870cb6-7a9c-42bc-acce-ce4f6c9ced14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.128244 Aug 04 13:59:53.043137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 294/614] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:52 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:53.838533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cf49901f-4d19-42d2-93c1-0956a053b681 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:53.839522 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cf49901f-4d19-42d2-93c1-0956a053b681 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:53.846527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf49901f-4d19-42d2-93c1-0956a053b681 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:53.846968 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf49901f-4d19-42d2-93c1-0956a053b681 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:53.847745 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf49901f-4d19-42d2-93c1-0956a053b681 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:53.848180 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf49901f-4d19-42d2-93c1-0956a053b681 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:53.972163 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cf49901f-4d19-42d2-93c1-0956a053b681 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.137146 Aug 04 13:59:53.976464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 321/615] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:53 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:59:54.052862 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-38df146c-f935-440f-adda-c2902ceb31d4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:54.053925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-38df146c-f935-440f-adda-c2902ceb31d4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:54.062361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38df146c-f935-440f-adda-c2902ceb31d4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:54.063069 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38df146c-f935-440f-adda-c2902ceb31d4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:54.063862 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38df146c-f935-440f-adda-c2902ceb31d4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:54.064338 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38df146c-f935-440f-adda-c2902ceb31d4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:54.175694 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-38df146c-f935-440f-adda-c2902ceb31d4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.127475 Aug 04 13:59:54.176495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 295/616] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:54 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:54.984933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2ffa1c02-f07f-4868-bb1c-3ab2bc83d6fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:54.985792 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2ffa1c02-f07f-4868-bb1c-3ab2bc83d6fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:54.992615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ffa1c02-f07f-4868-bb1c-3ab2bc83d6fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:54.993067 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ffa1c02-f07f-4868-bb1c-3ab2bc83d6fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:54.993844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ffa1c02-f07f-4868-bb1c-3ab2bc83d6fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:54.994281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2ffa1c02-f07f-4868-bb1c-3ab2bc83d6fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:55.127269 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2ffa1c02-f07f-4868-bb1c-3ab2bc83d6fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.146420 Aug 04 13:59:55.127957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 322/617] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:54 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:55.188342 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c34e2d8c-e8c7-4383-8e91-6295f1f9d821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:55.189339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c34e2d8c-e8c7-4383-8e91-6295f1f9d821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:55.196031 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c34e2d8c-e8c7-4383-8e91-6295f1f9d821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:55.196519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c34e2d8c-e8c7-4383-8e91-6295f1f9d821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:55.197563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c34e2d8c-e8c7-4383-8e91-6295f1f9d821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:55.198003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c34e2d8c-e8c7-4383-8e91-6295f1f9d821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:55.312669 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c34e2d8c-e8c7-4383-8e91-6295f1f9d821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.127981 Aug 04 13:59:55.313628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 296/618] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:55 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:59:56.140141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-de751758-ce2b-4b00-bbcf-75291c75e150 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:56.141143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-de751758-ce2b-4b00-bbcf-75291c75e150 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:56.147573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de751758-ce2b-4b00-bbcf-75291c75e150 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:56.148016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de751758-ce2b-4b00-bbcf-75291c75e150 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:56.148811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de751758-ce2b-4b00-bbcf-75291c75e150 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:56.149238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de751758-ce2b-4b00-bbcf-75291c75e150 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:56.269455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-de751758-ce2b-4b00-bbcf-75291c75e150 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.134007 Aug 04 13:59:56.270316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 323/619] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:56 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:59:56.327576 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d7d65ce3-58b8-4d0c-9e2d-915db34ddae9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:56.328590 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d7d65ce3-58b8-4d0c-9e2d-915db34ddae9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:56.334999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7d65ce3-58b8-4d0c-9e2d-915db34ddae9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:56.335444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7d65ce3-58b8-4d0c-9e2d-915db34ddae9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:56.336236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7d65ce3-58b8-4d0c-9e2d-915db34ddae9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:56.336667 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7d65ce3-58b8-4d0c-9e2d-915db34ddae9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:56.512804 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d7d65ce3-58b8-4d0c-9e2d-915db34ddae9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.189634 Aug 04 13:59:56.513484 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 297/620] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:56 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:57.282315 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6211de3f-28ea-4c8a-898d-399c8a709c29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:57.283263 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6211de3f-28ea-4c8a-898d-399c8a709c29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:57.291224 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6211de3f-28ea-4c8a-898d-399c8a709c29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:57.291679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6211de3f-28ea-4c8a-898d-399c8a709c29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:57.292504 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6211de3f-28ea-4c8a-898d-399c8a709c29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:57.292934 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6211de3f-28ea-4c8a-898d-399c8a709c29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:57.526427 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0567431f-2baa-469b-a882-f65dc01abb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:57.527416 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0567431f-2baa-469b-a882-f65dc01abb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 13:59:57.534698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0567431f-2baa-469b-a882-f65dc01abb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:57.535098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0567431f-2baa-469b-a882-f65dc01abb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 13:59:57.535884 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0567431f-2baa-469b-a882-f65dc01abb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 13:59:57.536308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0567431f-2baa-469b-a882-f65dc01abb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:02.723044 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6211de3f-28ea-4c8a-898d-399c8a709c29 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 5.445128 Aug 04 14:00:02.724958 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 324/621] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 13:59:57 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 5448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:02.749763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0567431f-2baa-469b-a882-f65dc01abb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 5.227153 Aug 04 14:00:02.750787 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 298/622] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 13:59:57 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 5229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:03.574259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-54266aeb-5469-492a-8617-d3b4cfd4a93d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:03.577388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-54266aeb-5469-492a-8617-d3b4cfd4a93d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:03.586989 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-54266aeb-5469-492a-8617-d3b4cfd4a93d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:03.587752 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-54266aeb-5469-492a-8617-d3b4cfd4a93d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:03.589125 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-54266aeb-5469-492a-8617-d3b4cfd4a93d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:03.589822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-54266aeb-5469-492a-8617-d3b4cfd4a93d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:03.622345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-54266aeb-5469-492a-8617-d3b4cfd4a93d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lazy-loading 'flavor' on Instance uuid 7ee769da-062a-4fe8-bd70-3dce1f031665 {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:00:03.736105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8eff6411-9f90-40cd-9e88-292b4a5adadc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:03.737121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8eff6411-9f90-40cd-9e88-292b4a5adadc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:03.743787 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8eff6411-9f90-40cd-9e88-292b4a5adadc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:03.744255 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8eff6411-9f90-40cd-9e88-292b4a5adadc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:03.745047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8eff6411-9f90-40cd-9e88-292b4a5adadc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:03.745481 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8eff6411-9f90-40cd-9e88-292b4a5adadc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:03.771764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-54266aeb-5469-492a-8617-d3b4cfd4a93d tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/action" status: 200 len: 32 microversion: 2.1 time: 0.205188 Aug 04 14:00:03.772722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 325/623] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:03 2021] POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:00:03.777914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b12c1174-2286-48c1-b7df-473d771977ec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:03.779043 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b12c1174-2286-48c1-b7df-473d771977ec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:03.791368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b12c1174-2286-48c1-b7df-473d771977ec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:03.791829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b12c1174-2286-48c1-b7df-473d771977ec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:03.792717 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b12c1174-2286-48c1-b7df-473d771977ec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:03.793283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b12c1174-2286-48c1-b7df-473d771977ec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:09.422140 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8eff6411-9f90-40cd-9e88-292b4a5adadc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 5.689654 Aug 04 14:00:09.423148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 299/624] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:03 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 5692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:09.431207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-48131501-2a45-4c25-8b98-2e7e6028418a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:09.432158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-48131501-2a45-4c25-8b98-2e7e6028418a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:09.437251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b12c1174-2286-48c1-b7df-473d771977ec tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 5.663036 Aug 04 14:00:09.437908 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 326/625] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:03 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 5665 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:09.442061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-48131501-2a45-4c25-8b98-2e7e6028418a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:09.442521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-48131501-2a45-4c25-8b98-2e7e6028418a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:09.443337 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-48131501-2a45-4c25-8b98-2e7e6028418a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:09.443777 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-48131501-2a45-4c25-8b98-2e7e6028418a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:09.595385 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-48131501-2a45-4c25-8b98-2e7e6028418a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:09.606070 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-48131501-2a45-4c25-8b98-2e7e6028418a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1567 microversion: 2.1 time: 0.181062 Aug 04 14:00:09.606673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 300/626] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:09 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:10.434687 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-336e9027-949f-4571-96f2-1e571b413403 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:10.436058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-336e9027-949f-4571-96f2-1e571b413403 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:10.444714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-336e9027-949f-4571-96f2-1e571b413403 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:10.445704 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-336e9027-949f-4571-96f2-1e571b413403 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:10.446205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-336e9027-949f-4571-96f2-1e571b413403 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:10.446840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-336e9027-949f-4571-96f2-1e571b413403 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:10.454942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c9a80bb9-ba8d-4cdd-ae37-d2647c731a83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:10.456492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c9a80bb9-ba8d-4cdd-ae37-d2647c731a83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:10.465734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c9a80bb9-ba8d-4cdd-ae37-d2647c731a83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:10.468023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c9a80bb9-ba8d-4cdd-ae37-d2647c731a83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:10.469421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c9a80bb9-ba8d-4cdd-ae37-d2647c731a83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:10.470026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c9a80bb9-ba8d-4cdd-ae37-d2647c731a83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:10.590847 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-336e9027-949f-4571-96f2-1e571b413403 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.160163 Aug 04 14:00:10.595133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 327/627] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:10 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:10.626046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-454c21f6-65ed-4397-9519-5c56aab40fe9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:10.626956 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-454c21f6-65ed-4397-9519-5c56aab40fe9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:10.634121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-454c21f6-65ed-4397-9519-5c56aab40fe9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:10.634560 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-454c21f6-65ed-4397-9519-5c56aab40fe9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:10.634885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c9a80bb9-ba8d-4cdd-ae37-d2647c731a83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.185598 Aug 04 14:00:10.635330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-454c21f6-65ed-4397-9519-5c56aab40fe9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:10.636024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-454c21f6-65ed-4397-9519-5c56aab40fe9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:10.640366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 301/628] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:10 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:10.807934 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-454c21f6-65ed-4397-9519-5c56aab40fe9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:10.817458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-454c21f6-65ed-4397-9519-5c56aab40fe9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1567 microversion: 2.1 time: 0.197246 Aug 04 14:00:10.818047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 328/629] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:10 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:11.431957 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1159089707", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "71fdc264-6c79-4112-8159-7717a7075144"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:11.511419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] validate_networks() for [('71fdc264-6c79-4112-8159-7717a7075144', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:00:11.608363 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b0df2b9f-b319-4b80-86f2-044f333ba593 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:11.609905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b0df2b9f-b319-4b80-86f2-044f333ba593 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:11.620343 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b0df2b9f-b319-4b80-86f2-044f333ba593 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:11.621093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b0df2b9f-b319-4b80-86f2-044f333ba593 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:11.623188 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b0df2b9f-b319-4b80-86f2-044f333ba593 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:11.623982 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b0df2b9f-b319-4b80-86f2-044f333ba593 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:11.912324 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:00:11.912741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:00:11.913200 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:00:11.913601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:00:11.914003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:00:11.924433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:11.924979 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:11.925761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:11.926187 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:11.943789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Getting quotas for project 21c2c98b135f4239ab56572ec4a259e1. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:00:11.948458 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Getting quotas for user f19e6144804c449586614d68ec2abe7b and project 21c2c98b135f4239ab56572ec4a259e1. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:00:11.960147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:00:11.962597 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:00:12.013599 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-72cd03e8-432a-41cc-adc0-e7cc7438108f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588357 Aug 04 14:00:12.014726 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 302/630] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:00:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:00:12.023375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ebe0efdf-1b60-486c-bf1b-7483689991bf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:12.025111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ebe0efdf-1b60-486c-bf1b-7483689991bf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:12.036978 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ebe0efdf-1b60-486c-bf1b-7483689991bf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:12.037770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ebe0efdf-1b60-486c-bf1b-7483689991bf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:12.039158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ebe0efdf-1b60-486c-bf1b-7483689991bf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:12.039944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ebe0efdf-1b60-486c-bf1b-7483689991bf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:16.065711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b0df2b9f-b319-4b80-86f2-044f333ba593 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 4.465108 Aug 04 14:00:16.067294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 329/631] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:11 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 4467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:16.071582 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3f67ee58-24cc-4b6d-8f84-3b745a1414a9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:16.072558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3f67ee58-24cc-4b6d-8f84-3b745a1414a9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:16.079533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f67ee58-24cc-4b6d-8f84-3b745a1414a9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:16.079891 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f67ee58-24cc-4b6d-8f84-3b745a1414a9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:16.080698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f67ee58-24cc-4b6d-8f84-3b745a1414a9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:16.081126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f67ee58-24cc-4b6d-8f84-3b745a1414a9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:16.137749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ebe0efdf-1b60-486c-bf1b-7483689991bf tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 4.121150 Aug 04 14:00:16.138439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 303/632] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:12 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 4123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:16.143631 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8e0e9c66-f80c-4e8c-94c4-14eaaa16ddbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:16.144365 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8e0e9c66-f80c-4e8c-94c4-14eaaa16ddbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:16.151357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c66-f80c-4e8c-94c4-14eaaa16ddbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:16.151812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c66-f80c-4e8c-94c4-14eaaa16ddbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:16.152874 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c66-f80c-4e8c-94c4-14eaaa16ddbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:16.153312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c66-f80c-4e8c-94c4-14eaaa16ddbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:16.227211 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3f67ee58-24cc-4b6d-8f84-3b745a1414a9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:16.236201 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3f67ee58-24cc-4b6d-8f84-3b745a1414a9 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1567 microversion: 2.1 time: 0.168640 Aug 04 14:00:16.236948 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 330/633] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:16 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:16.253630 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8e0e9c66-f80c-4e8c-94c4-14eaaa16ddbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:16.268919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8e0e9c66-f80c-4e8c-94c4-14eaaa16ddbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1222 microversion: 2.1 time: 0.128976 Aug 04 14:00:16.269533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 304/634] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:16 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:17.079057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b364cac8-7292-4fe0-8386-5fd4fd3455a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:17.080004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b364cac8-7292-4fe0-8386-5fd4fd3455a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:17.088166 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b364cac8-7292-4fe0-8386-5fd4fd3455a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:17.089017 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b364cac8-7292-4fe0-8386-5fd4fd3455a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:17.090058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b364cac8-7292-4fe0-8386-5fd4fd3455a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:17.090583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b364cac8-7292-4fe0-8386-5fd4fd3455a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:17.154897 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4d14e6c9-0771-47fb-bbf9-2df2258cd1b4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:17.155971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4d14e6c9-0771-47fb-bbf9-2df2258cd1b4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:17.162841 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d14e6c9-0771-47fb-bbf9-2df2258cd1b4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:17.163289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d14e6c9-0771-47fb-bbf9-2df2258cd1b4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:17.164135 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d14e6c9-0771-47fb-bbf9-2df2258cd1b4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:17.164593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d14e6c9-0771-47fb-bbf9-2df2258cd1b4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:17.216091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b364cac8-7292-4fe0-8386-5fd4fd3455a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.140558 Aug 04 14:00:17.216780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 331/635] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:17 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:17.254171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cdc92b08-29c0-4b5e-86d3-e9f9d4384036 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:17.254862 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cdc92b08-29c0-4b5e-86d3-e9f9d4384036 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:17.261694 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cdc92b08-29c0-4b5e-86d3-e9f9d4384036 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:17.262138 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cdc92b08-29c0-4b5e-86d3-e9f9d4384036 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:17.263598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cdc92b08-29c0-4b5e-86d3-e9f9d4384036 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:17.264039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cdc92b08-29c0-4b5e-86d3-e9f9d4384036 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:17.331508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4d14e6c9-0771-47fb-bbf9-2df2258cd1b4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.184805 Aug 04 14:00:17.339470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 305/636] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:17 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:17.348531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f020838f-0d19-41b3-945b-ca18ee243e20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:17.349761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f020838f-0d19-41b3-945b-ca18ee243e20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:17.356842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f020838f-0d19-41b3-945b-ca18ee243e20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:17.357291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f020838f-0d19-41b3-945b-ca18ee243e20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:17.358286 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f020838f-0d19-41b3-945b-ca18ee243e20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:17.358775 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f020838f-0d19-41b3-945b-ca18ee243e20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:17.440630 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f020838f-0d19-41b3-945b-ca18ee243e20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:17.453889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f020838f-0d19-41b3-945b-ca18ee243e20 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1288 microversion: 2.1 time: 0.111794 Aug 04 14:00:17.454659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 306/637] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:17 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:17.497049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cdc92b08-29c0-4b5e-86d3-e9f9d4384036 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:17.506236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cdc92b08-29c0-4b5e-86d3-e9f9d4384036 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1567 microversion: 2.1 time: 0.256117 Aug 04 14:00:17.506813 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 332/638] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:17 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:17.684461 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:00:17.684769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:00:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:00:18.233167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cf698a80-0c94-4ba3-972b-29f69840ecec tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:18.236167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cf698a80-0c94-4ba3-972b-29f69840ecec tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:18.250818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cf698a80-0c94-4ba3-972b-29f69840ecec tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:18.251631 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cf698a80-0c94-4ba3-972b-29f69840ecec tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:18.253470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cf698a80-0c94-4ba3-972b-29f69840ecec tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:18.254575 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cf698a80-0c94-4ba3-972b-29f69840ecec tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:18.352206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a565c438-b836-40ca-b27f-537dad8f0c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:18.353414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a565c438-b836-40ca-b27f-537dad8f0c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:18.362442 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a565c438-b836-40ca-b27f-537dad8f0c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:18.363368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a565c438-b836-40ca-b27f-537dad8f0c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:18.364981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a565c438-b836-40ca-b27f-537dad8f0c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:18.365730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a565c438-b836-40ca-b27f-537dad8f0c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:18.496634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cf698a80-0c94-4ba3-972b-29f69840ecec tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.272110 Aug 04 14:00:18.497931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 307/639] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:18 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:18.505047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d5343d2e-b9da-40fb-ae65-04a39cbcc124 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:18.505757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d5343d2e-b9da-40fb-ae65-04a39cbcc124 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:18.512935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5343d2e-b9da-40fb-ae65-04a39cbcc124 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:18.513491 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5343d2e-b9da-40fb-ae65-04a39cbcc124 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:18.514310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5343d2e-b9da-40fb-ae65-04a39cbcc124 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:18.514757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d5343d2e-b9da-40fb-ae65-04a39cbcc124 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:18.526249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a565c438-b836-40ca-b27f-537dad8f0c3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.181787 Aug 04 14:00:18.527420 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 333/640] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:18 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:18.534950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-46b488e9-891b-488c-8ab6-1119b2b724af tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:18.535651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-46b488e9-891b-488c-8ab6-1119b2b724af tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:18.556250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-46b488e9-891b-488c-8ab6-1119b2b724af tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:18.557143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-46b488e9-891b-488c-8ab6-1119b2b724af tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:18.564588 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-46b488e9-891b-488c-8ab6-1119b2b724af tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:18.564588 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-46b488e9-891b-488c-8ab6-1119b2b724af tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:18.710756 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d5343d2e-b9da-40fb-ae65-04a39cbcc124 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:18.722800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d5343d2e-b9da-40fb-ae65-04a39cbcc124 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.222904 Aug 04 14:00:18.724285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 308/641] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:18 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:18.832078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-46b488e9-891b-488c-8ab6-1119b2b724af tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:18.841091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-46b488e9-891b-488c-8ab6-1119b2b724af tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1567 microversion: 2.1 time: 0.311459 Aug 04 14:00:18.841923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 334/642] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:18 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:19.054268 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-ff1fb071-75ab-4bb6-b9a8-0946d72947e7 req-ed18e885-647b-4007-bee2-79a99a33afe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dc1422-f4fa-4416-9b79-15b3c7007585", "tag": "0fc8291a-e253-4038-bcac-04eafda43f22"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:19.056418 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:00:19.056418 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:00:19.066233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ff1fb071-75ab-4bb6-b9a8-0946d72947e7 req-ed18e885-647b-4007-bee2-79a99a33afe4 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:19.066600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ff1fb071-75ab-4bb6-b9a8-0946d72947e7 req-ed18e885-647b-4007-bee2-79a99a33afe4 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:19.078841 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-ff1fb071-75ab-4bb6-b9a8-0946d72947e7 req-ed18e885-647b-4007-bee2-79a99a33afe4 service nova] Creating event network-changed:0fc8291a-e253-4038-bcac-04eafda43f22 for instance 08dc1422-f4fa-4416-9b79-15b3c7007585 on hv-cinder-79264 Aug 04 14:00:19.083509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-ff1fb071-75ab-4bb6-b9a8-0946d72947e7 req-ed18e885-647b-4007-bee2-79a99a33afe4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034556 Aug 04 14:00:19.084151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 309/643] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:00:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:00:19.509219 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-15ae35c2-6769-477c-9542-156fbf05b56f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:19.510132 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-15ae35c2-6769-477c-9542-156fbf05b56f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:19.516656 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-15ae35c2-6769-477c-9542-156fbf05b56f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:19.517100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-15ae35c2-6769-477c-9542-156fbf05b56f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:19.517888 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-15ae35c2-6769-477c-9542-156fbf05b56f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:19.518322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-15ae35c2-6769-477c-9542-156fbf05b56f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:19.540135 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8b16d63c-ef57-4d0f-b5bf-de3bfb9c1bd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:19.542189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8b16d63c-ef57-4d0f-b5bf-de3bfb9c1bd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:19.550234 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8b16d63c-ef57-4d0f-b5bf-de3bfb9c1bd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:19.551323 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8b16d63c-ef57-4d0f-b5bf-de3bfb9c1bd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:19.552385 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8b16d63c-ef57-4d0f-b5bf-de3bfb9c1bd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:19.552928 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8b16d63c-ef57-4d0f-b5bf-de3bfb9c1bd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:20.523589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-15ae35c2-6769-477c-9542-156fbf05b56f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 1.017887 Aug 04 14:00:20.527366 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 335/644] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:19 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:20.529846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4c2bdf59-4735-4aca-b8cb-969ac594abdf tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:20.530534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4c2bdf59-4735-4aca-b8cb-969ac594abdf tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:20.536929 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c2bdf59-4735-4aca-b8cb-969ac594abdf tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:20.537368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c2bdf59-4735-4aca-b8cb-969ac594abdf tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:20.538139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c2bdf59-4735-4aca-b8cb-969ac594abdf tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:20.538569 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c2bdf59-4735-4aca-b8cb-969ac594abdf tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:20.644849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8b16d63c-ef57-4d0f-b5bf-de3bfb9c1bd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 1.109101 Aug 04 14:00:20.645868 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 310/645] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:19 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:20.651050 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d0897071-76de-413d-b328-0120802bfd0c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:20.651740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d0897071-76de-413d-b328-0120802bfd0c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:20.658018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0897071-76de-413d-b328-0120802bfd0c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:20.658637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0897071-76de-413d-b328-0120802bfd0c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:20.659621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0897071-76de-413d-b328-0120802bfd0c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:20.660044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0897071-76de-413d-b328-0120802bfd0c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:20.666219 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4c2bdf59-4735-4aca-b8cb-969ac594abdf tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:20.675256 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4c2bdf59-4735-4aca-b8cb-969ac594abdf tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.149347 Aug 04 14:00:20.676107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 336/646] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:20 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:20.878125 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d0897071-76de-413d-b328-0120802bfd0c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:20.885866 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d0897071-76de-413d-b328-0120802bfd0c tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1567 microversion: 2.1 time: 0.239007 Aug 04 14:00:20.886436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 311/647] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:20 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:21.536286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-07f36c54-dc4a-4dff-b6aa-20e46e41317d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:21.537201 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-07f36c54-dc4a-4dff-b6aa-20e46e41317d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:21.543519 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07f36c54-dc4a-4dff-b6aa-20e46e41317d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:21.544050 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07f36c54-dc4a-4dff-b6aa-20e46e41317d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:21.545048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07f36c54-dc4a-4dff-b6aa-20e46e41317d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:21.545480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07f36c54-dc4a-4dff-b6aa-20e46e41317d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:21.657990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-31061133-e038-44d9-b44a-4b2121777564 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:21.659013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-31061133-e038-44d9-b44a-4b2121777564 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:21.666913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-31061133-e038-44d9-b44a-4b2121777564 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:21.667358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-31061133-e038-44d9-b44a-4b2121777564 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:21.668306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-31061133-e038-44d9-b44a-4b2121777564 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:21.668791 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-31061133-e038-44d9-b44a-4b2121777564 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:21.759920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-07f36c54-dc4a-4dff-b6aa-20e46e41317d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.227581 Aug 04 14:00:21.760594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 337/648] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:21 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:21.766680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ce2e63e5-a91f-4ac7-845a-47f188bec931 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:21.767377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ce2e63e5-a91f-4ac7-845a-47f188bec931 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:21.774913 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ce2e63e5-a91f-4ac7-845a-47f188bec931 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:21.775537 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ce2e63e5-a91f-4ac7-845a-47f188bec931 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:21.776123 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ce2e63e5-a91f-4ac7-845a-47f188bec931 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:21.776584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ce2e63e5-a91f-4ac7-845a-47f188bec931 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:21.820404 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-31061133-e038-44d9-b44a-4b2121777564 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.167417 Aug 04 14:00:21.821496 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 312/649] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:21 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:21.904561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-55265de3-b350-4f53-ba4b-eb222138cf29 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:21.905608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-55265de3-b350-4f53-ba4b-eb222138cf29 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:21.912579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-55265de3-b350-4f53-ba4b-eb222138cf29 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:21.913032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-55265de3-b350-4f53-ba4b-eb222138cf29 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:21.913816 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-55265de3-b350-4f53-ba4b-eb222138cf29 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:21.914257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-55265de3-b350-4f53-ba4b-eb222138cf29 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:21.918023 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ce2e63e5-a91f-4ac7-845a-47f188bec931 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:21.926587 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ce2e63e5-a91f-4ac7-845a-47f188bec931 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.164627 Aug 04 14:00:21.927162 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 338/650] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:21 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:22.277047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-55265de3-b350-4f53-ba4b-eb222138cf29 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:22.285956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-55265de3-b350-4f53-ba4b-eb222138cf29 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1567 microversion: 2.1 time: 0.386461 Aug 04 14:00:22.286535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 313/651] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:21 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1567 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:22.774000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cab1b9fb-6ccd-4b55-b118-cfa297de5975 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:22.775031 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cab1b9fb-6ccd-4b55-b118-cfa297de5975 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:22.782467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cab1b9fb-6ccd-4b55-b118-cfa297de5975 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:22.782906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cab1b9fb-6ccd-4b55-b118-cfa297de5975 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:22.783687 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cab1b9fb-6ccd-4b55-b118-cfa297de5975 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:22.784112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cab1b9fb-6ccd-4b55-b118-cfa297de5975 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:22.833417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a331da77-2f1d-443c-8873-80b07631a84f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:22.834303 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a331da77-2f1d-443c-8873-80b07631a84f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:22.840885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a331da77-2f1d-443c-8873-80b07631a84f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:22.842058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a331da77-2f1d-443c-8873-80b07631a84f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:22.842941 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a331da77-2f1d-443c-8873-80b07631a84f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:22.843373 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a331da77-2f1d-443c-8873-80b07631a84f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.011419 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cab1b9fb-6ccd-4b55-b118-cfa297de5975 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.241178 Aug 04 14:00:23.012065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 339/652] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:22 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:23.017520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bbe98e1f-5f02-4b4a-ac9f-ec4743f4d019 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:23.018205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bbe98e1f-5f02-4b4a-ac9f-ec4743f4d019 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:23.025144 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bbe98e1f-5f02-4b4a-ac9f-ec4743f4d019 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.025464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bbe98e1f-5f02-4b4a-ac9f-ec4743f4d019 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.026241 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bbe98e1f-5f02-4b4a-ac9f-ec4743f4d019 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.026651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bbe98e1f-5f02-4b4a-ac9f-ec4743f4d019 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.049923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a331da77-2f1d-443c-8873-80b07631a84f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.219970 Aug 04 14:00:23.051148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 314/653] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:22 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:23.164478 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bbe98e1f-5f02-4b4a-ac9f-ec4743f4d019 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:23.172894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bbe98e1f-5f02-4b4a-ac9f-ec4743f4d019 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.159476 Aug 04 14:00:23.173470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 340/654] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:23 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:23.303420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9fdd5970-5fe3-4bf4-842e-04532836a07a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:23.304312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9fdd5970-5fe3-4bf4-842e-04532836a07a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:23.312653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9fdd5970-5fe3-4bf4-842e-04532836a07a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.313485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9fdd5970-5fe3-4bf4-842e-04532836a07a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.314810 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9fdd5970-5fe3-4bf4-842e-04532836a07a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.315469 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9fdd5970-5fe3-4bf4-842e-04532836a07a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.455133 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9fdd5970-5fe3-4bf4-842e-04532836a07a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:23.465121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9fdd5970-5fe3-4bf4-842e-04532836a07a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1547 microversion: 2.1 time: 0.165808 Aug 04 14:00:23.466876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 315/655] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:23 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:23.484286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:23.484792 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:23.491142 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.491584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.492394 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.492822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.600534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] HTTP exception thrown: Cannot 'detach_volume' instance 7ee769da-062a-4fe8-bd70-3dce1f031665 while it is in vm_state rescued Aug 04 14:00:23.601140 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Returning 409 to user: Cannot 'detach_volume' instance 7ee769da-062a-4fe8-bd70-3dce1f031665 while it is in vm_state rescued {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:00:23.601981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8c6f188f-9e13-4f13-9b88-3b0c384007bb tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/os-volume_attachments/840e4260-9f46-477d-8034-6ecf378b4614" status: 409 len: 152 microversion: 2.1 time: 0.122638 Aug 04 14:00:23.602554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 341/656] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:00:23 2021] DELETE /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/os-volume_attachments/840e4260-9f46-477d-8034-6ecf378b4614 => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:00:23.612940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7742c91f-bc48-46a7-9ade-2d10d8d3e39b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:23.613282 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7742c91f-bc48-46a7-9ade-2d10d8d3e39b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:23.619876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7742c91f-bc48-46a7-9ade-2d10d8d3e39b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.620321 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7742c91f-bc48-46a7-9ade-2d10d8d3e39b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.621067 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7742c91f-bc48-46a7-9ade-2d10d8d3e39b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.621504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7742c91f-bc48-46a7-9ade-2d10d8d3e39b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.702478 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7742c91f-bc48-46a7-9ade-2d10d8d3e39b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/action" status: 202 len: 0 microversion: 2.1 time: 0.093952 Aug 04 14:00:23.703417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 316/657] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:23 2021] POST /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:23.714783 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a5a0a37c-a225-4f1f-a774-463f7b3ec417 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:23.715400 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a5a0a37c-a225-4f1f-a774-463f7b3ec417 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:23.723887 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a5a0a37c-a225-4f1f-a774-463f7b3ec417 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.724333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a5a0a37c-a225-4f1f-a774-463f7b3ec417 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.725226 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a5a0a37c-a225-4f1f-a774-463f7b3ec417 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:23.725811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a5a0a37c-a225-4f1f-a774-463f7b3ec417 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:23.893088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a5a0a37c-a225-4f1f-a774-463f7b3ec417 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:23.902182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a5a0a37c-a225-4f1f-a774-463f7b3ec417 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1555 microversion: 2.1 time: 0.191194 Aug 04 14:00:23.902805 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 342/658] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:23 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:24.024521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-584d427d-5bd0-4f6e-a05a-f151c95632fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:24.025728 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-584d427d-5bd0-4f6e-a05a-f151c95632fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:24.035375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-584d427d-5bd0-4f6e-a05a-f151c95632fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:24.036264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-584d427d-5bd0-4f6e-a05a-f151c95632fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:24.037173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-584d427d-5bd0-4f6e-a05a-f151c95632fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:24.037769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-584d427d-5bd0-4f6e-a05a-f151c95632fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:24.066789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6e483d53-a539-4ff1-9899-ac138bffd67d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:24.068778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6e483d53-a539-4ff1-9899-ac138bffd67d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:24.081224 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6e483d53-a539-4ff1-9899-ac138bffd67d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:24.082053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6e483d53-a539-4ff1-9899-ac138bffd67d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:24.083423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6e483d53-a539-4ff1-9899-ac138bffd67d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:24.084519 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6e483d53-a539-4ff1-9899-ac138bffd67d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:24.375182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6e483d53-a539-4ff1-9899-ac138bffd67d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.315826 Aug 04 14:00:24.380543 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 343/659] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:24 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:24.381207 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fc162379-113d-4b53-a9a1-8a81bcd3bded tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:24.382101 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fc162379-113d-4b53-a9a1-8a81bcd3bded tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:24.392550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fc162379-113d-4b53-a9a1-8a81bcd3bded tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:24.393006 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fc162379-113d-4b53-a9a1-8a81bcd3bded tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:24.394215 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-584d427d-5bd0-4f6e-a05a-f151c95632fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.372689 Aug 04 14:00:24.394451 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fc162379-113d-4b53-a9a1-8a81bcd3bded tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:24.394802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fc162379-113d-4b53-a9a1-8a81bcd3bded tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:24.400167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 317/660] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:24 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:24.559095 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fc162379-113d-4b53-a9a1-8a81bcd3bded tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:24.568496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fc162379-113d-4b53-a9a1-8a81bcd3bded tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.191280 Aug 04 14:00:24.569084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 344/661] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:24 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:24.924044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-29501f0c-c910-47c5-bfba-e28e94b6b762 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:24.924920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-29501f0c-c910-47c5-bfba-e28e94b6b762 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:24.934504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-29501f0c-c910-47c5-bfba-e28e94b6b762 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:24.935166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-29501f0c-c910-47c5-bfba-e28e94b6b762 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:24.936495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-29501f0c-c910-47c5-bfba-e28e94b6b762 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:24.937209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-29501f0c-c910-47c5-bfba-e28e94b6b762 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:25.135959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-29501f0c-c910-47c5-bfba-e28e94b6b762 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:25.146536 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-29501f0c-c910-47c5-bfba-e28e94b6b762 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1555 microversion: 2.1 time: 0.229016 Aug 04 14:00:25.147354 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 318/662] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:24 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:25.388865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-657ffc8c-ceff-4e99-8a7c-33cd89e52ee6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:25.390528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-657ffc8c-ceff-4e99-8a7c-33cd89e52ee6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:25.402194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-657ffc8c-ceff-4e99-8a7c-33cd89e52ee6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:25.402946 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-657ffc8c-ceff-4e99-8a7c-33cd89e52ee6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:25.406104 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-657ffc8c-ceff-4e99-8a7c-33cd89e52ee6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:25.406104 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-657ffc8c-ceff-4e99-8a7c-33cd89e52ee6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:25.409885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7759721f-6ce0-416a-ac11-cf6b6de3b858 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:25.410819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7759721f-6ce0-416a-ac11-cf6b6de3b858 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:25.416746 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7759721f-6ce0-416a-ac11-cf6b6de3b858 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:25.417166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7759721f-6ce0-416a-ac11-cf6b6de3b858 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:25.417958 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7759721f-6ce0-416a-ac11-cf6b6de3b858 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:25.418393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7759721f-6ce0-416a-ac11-cf6b6de3b858 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:25.518059 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-657ffc8c-ceff-4e99-8a7c-33cd89e52ee6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.134283 Aug 04 14:00:25.518802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 345/663] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:25 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:25.547329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7759721f-6ce0-416a-ac11-cf6b6de3b858 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.142318 Aug 04 14:00:25.548007 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 319/664] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:25 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:25.592142 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bdc1dede-3ded-4787-9bfd-cc4afa42f5e2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:25.593455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bdc1dede-3ded-4787-9bfd-cc4afa42f5e2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:25.605070 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdc1dede-3ded-4787-9bfd-cc4afa42f5e2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:25.605858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdc1dede-3ded-4787-9bfd-cc4afa42f5e2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:25.607707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdc1dede-3ded-4787-9bfd-cc4afa42f5e2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:25.608500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdc1dede-3ded-4787-9bfd-cc4afa42f5e2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:25.770077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bdc1dede-3ded-4787-9bfd-cc4afa42f5e2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:25.778567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bdc1dede-3ded-4787-9bfd-cc4afa42f5e2 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.194839 Aug 04 14:00:25.779153 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 346/665] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:25 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:26.094920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:00:26.095338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:00:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:00:26.170614 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-37233d93-1070-4b36-b47a-cadda6d43cee tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:26.171497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-37233d93-1070-4b36-b47a-cadda6d43cee tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:26.178964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-37233d93-1070-4b36-b47a-cadda6d43cee tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:26.179411 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-37233d93-1070-4b36-b47a-cadda6d43cee tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:26.180204 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-37233d93-1070-4b36-b47a-cadda6d43cee tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:26.180688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-37233d93-1070-4b36-b47a-cadda6d43cee tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:26.324548 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-37233d93-1070-4b36-b47a-cadda6d43cee tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:26.334236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-37233d93-1070-4b36-b47a-cadda6d43cee tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1555 microversion: 2.1 time: 0.168499 Aug 04 14:00:26.334980 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 320/666] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:26 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:26.530587 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e5e74ca7-0f7e-452c-8c50-b830a3aad5fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:26.532169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e5e74ca7-0f7e-452c-8c50-b830a3aad5fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:26.538177 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e5e74ca7-0f7e-452c-8c50-b830a3aad5fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:26.538614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e5e74ca7-0f7e-452c-8c50-b830a3aad5fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:26.539378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e5e74ca7-0f7e-452c-8c50-b830a3aad5fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:26.539803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e5e74ca7-0f7e-452c-8c50-b830a3aad5fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:26.561265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-958088b6-0444-4e3d-9e5d-c41049baadd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:26.562178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-958088b6-0444-4e3d-9e5d-c41049baadd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:26.568021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-958088b6-0444-4e3d-9e5d-c41049baadd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:26.568495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-958088b6-0444-4e3d-9e5d-c41049baadd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:26.569274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-958088b6-0444-4e3d-9e5d-c41049baadd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:26.569700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-958088b6-0444-4e3d-9e5d-c41049baadd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:26.691043 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-958088b6-0444-4e3d-9e5d-c41049baadd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.133265 Aug 04 14:00:26.691999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 321/667] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:26 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:26.710454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e5e74ca7-0f7e-452c-8c50-b830a3aad5fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.183260 Aug 04 14:00:26.711474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 347/668] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:26 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:26.797588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1f0fc187-87a0-4cc1-b319-11576429439e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:26.798378 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1f0fc187-87a0-4cc1-b319-11576429439e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:26.805453 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1f0fc187-87a0-4cc1-b319-11576429439e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:26.805899 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1f0fc187-87a0-4cc1-b319-11576429439e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:26.806684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1f0fc187-87a0-4cc1-b319-11576429439e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:26.807111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1f0fc187-87a0-4cc1-b319-11576429439e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:26.948185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1f0fc187-87a0-4cc1-b319-11576429439e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:26.961892 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1f0fc187-87a0-4cc1-b319-11576429439e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.168936 Aug 04 14:00:26.962993 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 322/669] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:26 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:27.356975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fb5675e8-bbb1-4fc5-a8c4-7ff2c31c4785 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:27.357588 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fb5675e8-bbb1-4fc5-a8c4-7ff2c31c4785 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:27.364630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb5675e8-bbb1-4fc5-a8c4-7ff2c31c4785 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:27.365108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb5675e8-bbb1-4fc5-a8c4-7ff2c31c4785 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:27.365914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb5675e8-bbb1-4fc5-a8c4-7ff2c31c4785 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:27.366344 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb5675e8-bbb1-4fc5-a8c4-7ff2c31c4785 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:27.524331 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fb5675e8-bbb1-4fc5-a8c4-7ff2c31c4785 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:27.533170 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fb5675e8-bbb1-4fc5-a8c4-7ff2c31c4785 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1555 microversion: 2.1 time: 0.182136 Aug 04 14:00:27.533991 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 348/670] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:27 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:27.706070 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d96ecc1c-73f4-4f3e-aa8f-a9606062fe9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:27.707001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d96ecc1c-73f4-4f3e-aa8f-a9606062fe9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:27.713096 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d96ecc1c-73f4-4f3e-aa8f-a9606062fe9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:27.713544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d96ecc1c-73f4-4f3e-aa8f-a9606062fe9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:27.714312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d96ecc1c-73f4-4f3e-aa8f-a9606062fe9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:27.714742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d96ecc1c-73f4-4f3e-aa8f-a9606062fe9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:27.723202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c57d0bb9-f208-4dcc-bca8-6bf4ef92f55e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:27.724165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c57d0bb9-f208-4dcc-bca8-6bf4ef92f55e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:27.730435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c57d0bb9-f208-4dcc-bca8-6bf4ef92f55e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:27.730878 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c57d0bb9-f208-4dcc-bca8-6bf4ef92f55e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:27.731664 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c57d0bb9-f208-4dcc-bca8-6bf4ef92f55e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:27.732092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c57d0bb9-f208-4dcc-bca8-6bf4ef92f55e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:27.859931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d96ecc1c-73f4-4f3e-aa8f-a9606062fe9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.157422 Aug 04 14:00:27.860789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 323/671] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:27 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:27.882145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c57d0bb9-f208-4dcc-bca8-6bf4ef92f55e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.162471 Aug 04 14:00:27.882804 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 349/672] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:27 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:27.980564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-45f9f2ad-03d2-4366-b630-b2f4c85c0130 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:27.981272 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-45f9f2ad-03d2-4366-b630-b2f4c85c0130 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:27.988077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45f9f2ad-03d2-4366-b630-b2f4c85c0130 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:27.988673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45f9f2ad-03d2-4366-b630-b2f4c85c0130 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:27.989612 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45f9f2ad-03d2-4366-b630-b2f4c85c0130 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:27.990049 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45f9f2ad-03d2-4366-b630-b2f4c85c0130 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:28.128549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-45f9f2ad-03d2-4366-b630-b2f4c85c0130 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:28.136493 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-45f9f2ad-03d2-4366-b630-b2f4c85c0130 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.160051 Aug 04 14:00:28.137095 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 324/673] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:27 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:28.551453 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7d6f8084-10ac-4e8b-af50-846e85fb77bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:28.552302 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7d6f8084-10ac-4e8b-af50-846e85fb77bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:28.560872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d6f8084-10ac-4e8b-af50-846e85fb77bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:28.562129 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d6f8084-10ac-4e8b-af50-846e85fb77bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:28.563144 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d6f8084-10ac-4e8b-af50-846e85fb77bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:28.563639 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d6f8084-10ac-4e8b-af50-846e85fb77bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:28.720479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7d6f8084-10ac-4e8b-af50-846e85fb77bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:28.729411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7d6f8084-10ac-4e8b-af50-846e85fb77bc tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1555 microversion: 2.1 time: 0.182576 Aug 04 14:00:28.730048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 350/674] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:28 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:28.871792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fccac497-ef98-49d9-be9e-83bca4c6a725 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:28.872758 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fccac497-ef98-49d9-be9e-83bca4c6a725 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:28.878781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fccac497-ef98-49d9-be9e-83bca4c6a725 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:28.879751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fccac497-ef98-49d9-be9e-83bca4c6a725 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:28.880069 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fccac497-ef98-49d9-be9e-83bca4c6a725 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:28.880555 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fccac497-ef98-49d9-be9e-83bca4c6a725 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:28.895353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b8185be6-8832-4fde-9b1f-759291e8566a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:28.896472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b8185be6-8832-4fde-9b1f-759291e8566a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:28.902637 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8185be6-8832-4fde-9b1f-759291e8566a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:28.903758 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8185be6-8832-4fde-9b1f-759291e8566a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:28.905042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8185be6-8832-4fde-9b1f-759291e8566a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:28.905482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8185be6-8832-4fde-9b1f-759291e8566a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:29.064051 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b8185be6-8832-4fde-9b1f-759291e8566a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.172611 Aug 04 14:00:29.064724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 351/675] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:28 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:29.081074 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fccac497-ef98-49d9-be9e-83bca4c6a725 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.212764 Aug 04 14:00:29.081714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 325/676] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:28 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:29.154973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6909d65d-b1e2-4b1d-a658-c6cd9c4d2555 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:29.155711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6909d65d-b1e2-4b1d-a658-c6cd9c4d2555 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:29.162510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6909d65d-b1e2-4b1d-a658-c6cd9c4d2555 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:29.162956 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6909d65d-b1e2-4b1d-a658-c6cd9c4d2555 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:29.163730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6909d65d-b1e2-4b1d-a658-c6cd9c4d2555 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:29.164160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6909d65d-b1e2-4b1d-a658-c6cd9c4d2555 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:29.311330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6909d65d-b1e2-4b1d-a658-c6cd9c4d2555 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:29.325739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6909d65d-b1e2-4b1d-a658-c6cd9c4d2555 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.175183 Aug 04 14:00:29.326305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 352/677] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:29 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:29.747976 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f1209699-93c4-4acb-8b53-de6c51b02c5e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:29.748802 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f1209699-93c4-4acb-8b53-de6c51b02c5e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:29.755755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f1209699-93c4-4acb-8b53-de6c51b02c5e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:29.756197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f1209699-93c4-4acb-8b53-de6c51b02c5e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:29.757009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f1209699-93c4-4acb-8b53-de6c51b02c5e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:29.757442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f1209699-93c4-4acb-8b53-de6c51b02c5e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:29.912562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f1209699-93c4-4acb-8b53-de6c51b02c5e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:29.922255 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f1209699-93c4-4acb-8b53-de6c51b02c5e tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1561 microversion: 2.1 time: 0.178806 Aug 04 14:00:29.924054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 326/678] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:29 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:30.004389 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a4d15322-c089-4741-a314-56c028035a79 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:30.004951 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a4d15322-c089-4741-a314-56c028035a79 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:30.010645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a4d15322-c089-4741-a314-56c028035a79 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.011185 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a4d15322-c089-4741-a314-56c028035a79 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.012040 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a4d15322-c089-4741-a314-56c028035a79 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.012998 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a4d15322-c089-4741-a314-56c028035a79 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.075290 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4fe8413e-030c-4658-8831-bda905fb3c0a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:30.076565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4fe8413e-030c-4658-8831-bda905fb3c0a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:30.083546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4fe8413e-030c-4658-8831-bda905fb3c0a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.084282 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4fe8413e-030c-4658-8831-bda905fb3c0a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.085274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4fe8413e-030c-4658-8831-bda905fb3c0a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.085709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4fe8413e-030c-4658-8831-bda905fb3c0a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.127299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-a4d15322-c089-4741-a314-56c028035a79 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lazy-loading 'services' on Instance uuid 7ee769da-062a-4fe8-bd70-3dce1f031665 {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:00:30.201020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4fe8413e-030c-4658-8831-bda905fb3c0a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.128795 Aug 04 14:00:30.205959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 327/679] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:30 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:30.207255 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c025da46-bae8-49c0-9612-87410cc7d577 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:30.208284 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c025da46-bae8-49c0-9612-87410cc7d577 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:30.208487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a4d15322-c089-4741-a314-56c028035a79 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/os-volume_attachments/840e4260-9f46-477d-8034-6ecf378b4614" status: 202 len: 0 microversion: 2.1 time: 0.208364 Aug 04 14:00:30.208871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 353/680] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:00:29 2021] DELETE /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665/os-volume_attachments/840e4260-9f46-477d-8034-6ecf378b4614 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:30.214288 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-3e0822c0-8c40-484a-bdf9-8761711b34c9 req-43c0c215-2994-4e4e-b6af-73b5914c8be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dc1422-f4fa-4416-9b79-15b3c7007585", "name": "network-vif-plugged", "status": "completed", "tag": "0fc8291a-e253-4038-bcac-04eafda43f22"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:30.215528 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c025da46-bae8-49c0-9612-87410cc7d577 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.217378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:00:30.217378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:00:30.217677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c025da46-bae8-49c0-9612-87410cc7d577 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.218687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c025da46-bae8-49c0-9612-87410cc7d577 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.219293 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c025da46-bae8-49c0-9612-87410cc7d577 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.231413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-3e0822c0-8c40-484a-bdf9-8761711b34c9 req-43c0c215-2994-4e4e-b6af-73b5914c8be9 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.232075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-3e0822c0-8c40-484a-bdf9-8761711b34c9 req-43c0c215-2994-4e4e-b6af-73b5914c8be9 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.248840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-3e0822c0-8c40-484a-bdf9-8761711b34c9 req-43c0c215-2994-4e4e-b6af-73b5914c8be9 service nova] Creating event network-vif-plugged:0fc8291a-e253-4038-bcac-04eafda43f22 for instance 08dc1422-f4fa-4416-9b79-15b3c7007585 on hv-cinder-79264 Aug 04 14:00:30.254047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-3e0822c0-8c40-484a-bdf9-8761711b34c9 req-43c0c215-2994-4e4e-b6af-73b5914c8be9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043693 Aug 04 14:00:30.254631 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 354/681] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:00:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:30.345901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-008d9c12-3288-4b00-8a1b-f1ca6bf7aa5d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:30.347046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-008d9c12-3288-4b00-8a1b-f1ca6bf7aa5d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:30.354699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-008d9c12-3288-4b00-8a1b-f1ca6bf7aa5d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.355174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-008d9c12-3288-4b00-8a1b-f1ca6bf7aa5d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.356231 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-008d9c12-3288-4b00-8a1b-f1ca6bf7aa5d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:30.358248 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-008d9c12-3288-4b00-8a1b-f1ca6bf7aa5d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:30.385691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c025da46-bae8-49c0-9612-87410cc7d577 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.182353 Aug 04 14:00:30.387009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 328/682] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:30 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:30.512443 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-008d9c12-3288-4b00-8a1b-f1ca6bf7aa5d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:30.521327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-008d9c12-3288-4b00-8a1b-f1ca6bf7aa5d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.179689 Aug 04 14:00:30.522096 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 355/683] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:30 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:31.214021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5c5a9acf-bac5-49ef-840c-af6cb47506d8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:31.215065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5c5a9acf-bac5-49ef-840c-af6cb47506d8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:31.226108 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c5a9acf-bac5-49ef-840c-af6cb47506d8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:31.226944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c5a9acf-bac5-49ef-840c-af6cb47506d8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:31.228389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c5a9acf-bac5-49ef-840c-af6cb47506d8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:31.229189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c5a9acf-bac5-49ef-840c-af6cb47506d8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:31.395322 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5c5a9acf-bac5-49ef-840c-af6cb47506d8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.185224 Aug 04 14:00:31.396203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 329/684] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:31 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:31.398835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-80ce2b87-80fb-4984-93b8-d7700077713f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:31.399958 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-80ce2b87-80fb-4984-93b8-d7700077713f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:31.407133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-80ce2b87-80fb-4984-93b8-d7700077713f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:31.407584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-80ce2b87-80fb-4984-93b8-d7700077713f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:31.408409 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-80ce2b87-80fb-4984-93b8-d7700077713f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:31.408855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-80ce2b87-80fb-4984-93b8-d7700077713f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:31.517801 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-80ce2b87-80fb-4984-93b8-d7700077713f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.122349 Aug 04 14:00:31.518358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 356/685] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:31 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:31.539184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-936d74cb-553e-4e0b-85d0-b8d35a9f8438 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:31.539904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-936d74cb-553e-4e0b-85d0-b8d35a9f8438 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:31.547233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-936d74cb-553e-4e0b-85d0-b8d35a9f8438 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:31.547673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-936d74cb-553e-4e0b-85d0-b8d35a9f8438 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:31.548482 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-936d74cb-553e-4e0b-85d0-b8d35a9f8438 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:31.548915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-936d74cb-553e-4e0b-85d0-b8d35a9f8438 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:31.682951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-936d74cb-553e-4e0b-85d0-b8d35a9f8438 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:31.691109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-936d74cb-553e-4e0b-85d0-b8d35a9f8438 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.155905 Aug 04 14:00:31.691702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 330/686] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:31 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:32.412267 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cd46e92b-8f3e-4d50-b70f-6b3d81e67017 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:32.415040 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cd46e92b-8f3e-4d50-b70f-6b3d81e67017 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:32.425458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd46e92b-8f3e-4d50-b70f-6b3d81e67017 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:32.425903 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd46e92b-8f3e-4d50-b70f-6b3d81e67017 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:32.426758 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd46e92b-8f3e-4d50-b70f-6b3d81e67017 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:32.427192 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd46e92b-8f3e-4d50-b70f-6b3d81e67017 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:32.530514 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4bad3849-464c-4fa5-aa79-8f75635b0f8f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:32.531470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4bad3849-464c-4fa5-aa79-8f75635b0f8f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:32.537783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bad3849-464c-4fa5-aa79-8f75635b0f8f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:32.538226 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bad3849-464c-4fa5-aa79-8f75635b0f8f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:32.539024 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bad3849-464c-4fa5-aa79-8f75635b0f8f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:32.539457 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bad3849-464c-4fa5-aa79-8f75635b0f8f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:32.671460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cd46e92b-8f3e-4d50-b70f-6b3d81e67017 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.264825 Aug 04 14:00:32.672030 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 357/687] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:32 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:32.704261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4bad3849-464c-4fa5-aa79-8f75635b0f8f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.178123 Aug 04 14:00:32.705220 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 331/688] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:32 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:32.710922 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-eb4f4896-3e50-4bf8-98ed-e8b0383909fb tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:32.711630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-eb4f4896-3e50-4bf8-98ed-e8b0383909fb tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:32.719004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eb4f4896-3e50-4bf8-98ed-e8b0383909fb tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:32.719517 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eb4f4896-3e50-4bf8-98ed-e8b0383909fb tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:32.720601 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eb4f4896-3e50-4bf8-98ed-e8b0383909fb tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:32.721073 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eb4f4896-3e50-4bf8-98ed-e8b0383909fb tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:32.887466 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-eb4f4896-3e50-4bf8-98ed-e8b0383909fb tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:32.895498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-eb4f4896-3e50-4bf8-98ed-e8b0383909fb tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1318 microversion: 2.1 time: 0.189215 Aug 04 14:00:32.896099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 358/689] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:32 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:33.685892 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2ad91a18-e5a4-42b0-aaa1-8fb645c65a66 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:33.687600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2ad91a18-e5a4-42b0-aaa1-8fb645c65a66 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:33.703742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ad91a18-e5a4-42b0-aaa1-8fb645c65a66 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:33.704183 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ad91a18-e5a4-42b0-aaa1-8fb645c65a66 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:33.705009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ad91a18-e5a4-42b0-aaa1-8fb645c65a66 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:33.705432 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ad91a18-e5a4-42b0-aaa1-8fb645c65a66 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:33.719838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-abecee73-2b9f-44ef-9f48-ad0c42691ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:33.720876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-abecee73-2b9f-44ef-9f48-ad0c42691ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:33.729812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abecee73-2b9f-44ef-9f48-ad0c42691ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:33.730523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abecee73-2b9f-44ef-9f48-ad0c42691ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:33.733181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abecee73-2b9f-44ef-9f48-ad0c42691ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:33.733886 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abecee73-2b9f-44ef-9f48-ad0c42691ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:33.815334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2ad91a18-e5a4-42b0-aaa1-8fb645c65a66 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.135344 Aug 04 14:00:33.815988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 332/690] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:33 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:33.848365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-abecee73-2b9f-44ef-9f48-ad0c42691ef1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.134516 Aug 04 14:00:33.849029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 359/691] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:33 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:33.914137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d7935886-01e7-417d-8355-085f93445854 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:33.914735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d7935886-01e7-417d-8355-085f93445854 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:33.922263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7935886-01e7-417d-8355-085f93445854 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:33.922715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7935886-01e7-417d-8355-085f93445854 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:33.923518 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7935886-01e7-417d-8355-085f93445854 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:33.923957 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7935886-01e7-417d-8355-085f93445854 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:34.059259 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d7935886-01e7-417d-8355-085f93445854 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:34.068883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d7935886-01e7-417d-8355-085f93445854 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1508 microversion: 2.1 time: 0.158848 Aug 04 14:00:34.069491 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 333/692] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:33 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:34.828557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-66524437-e245-45d1-aa65-c055718e55f7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:34.829583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-66524437-e245-45d1-aa65-c055718e55f7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:34.836401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66524437-e245-45d1-aa65-c055718e55f7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:34.836852 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66524437-e245-45d1-aa65-c055718e55f7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:34.837624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66524437-e245-45d1-aa65-c055718e55f7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:34.838058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66524437-e245-45d1-aa65-c055718e55f7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:34.862605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e14de986-add2-4d74-adfb-e5eaf1f0348e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:34.863521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e14de986-add2-4d74-adfb-e5eaf1f0348e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:34.870319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e14de986-add2-4d74-adfb-e5eaf1f0348e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:34.870773 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e14de986-add2-4d74-adfb-e5eaf1f0348e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:34.871547 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e14de986-add2-4d74-adfb-e5eaf1f0348e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:34.872685 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e14de986-add2-4d74-adfb-e5eaf1f0348e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:34.986768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-66524437-e245-45d1-aa65-c055718e55f7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.162707 Aug 04 14:00:34.987418 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 360/693] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:34 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:35.007495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e14de986-add2-4d74-adfb-e5eaf1f0348e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.148355 Aug 04 14:00:35.008372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 334/694] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:34 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:35.999918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2796945b-61cd-4d3e-b130-be08de9ed1b0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:36.000952 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2796945b-61cd-4d3e-b130-be08de9ed1b0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:36.008767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2796945b-61cd-4d3e-b130-be08de9ed1b0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:36.009204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2796945b-61cd-4d3e-b130-be08de9ed1b0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:36.009975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2796945b-61cd-4d3e-b130-be08de9ed1b0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:36.010432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2796945b-61cd-4d3e-b130-be08de9ed1b0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:36.020145 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0a7c093b-a462-4f94-815f-00f30b5bdd34 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:36.021193 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0a7c093b-a462-4f94-815f-00f30b5bdd34 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:36.027664 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a7c093b-a462-4f94-815f-00f30b5bdd34 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:36.028710 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a7c093b-a462-4f94-815f-00f30b5bdd34 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:36.029625 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a7c093b-a462-4f94-815f-00f30b5bdd34 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:36.030071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a7c093b-a462-4f94-815f-00f30b5bdd34 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:36.124252 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2796945b-61cd-4d3e-b130-be08de9ed1b0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.129143 Aug 04 14:00:36.125196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 361/695] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:35 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:36.145500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0a7c093b-a462-4f94-815f-00f30b5bdd34 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.129208 Aug 04 14:00:36.146157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 335/696] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:36 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:37.136652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6a7c3656-df75-48e9-8331-e0546bb8fa5a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:37.137652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6a7c3656-df75-48e9-8331-e0546bb8fa5a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:37.144380 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a7c3656-df75-48e9-8331-e0546bb8fa5a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:37.144837 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a7c3656-df75-48e9-8331-e0546bb8fa5a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:37.145622 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a7c3656-df75-48e9-8331-e0546bb8fa5a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:37.146053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a7c3656-df75-48e9-8331-e0546bb8fa5a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:37.157797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0dc5eb20-6715-422d-9ed5-ab16ab9288df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:37.158901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0dc5eb20-6715-422d-9ed5-ab16ab9288df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:37.165435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0dc5eb20-6715-422d-9ed5-ab16ab9288df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:37.165879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0dc5eb20-6715-422d-9ed5-ab16ab9288df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:37.166664 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0dc5eb20-6715-422d-9ed5-ab16ab9288df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:37.167095 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0dc5eb20-6715-422d-9ed5-ab16ab9288df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:37.246378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6a7c3656-df75-48e9-8331-e0546bb8fa5a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.113750 Aug 04 14:00:37.247857 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 362/697] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:37 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:37.272045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0dc5eb20-6715-422d-9ed5-ab16ab9288df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.118195 Aug 04 14:00:37.272736 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 336/698] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:37 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:38.259725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d8272b77-64fd-4801-916c-48c21ba9a16e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:38.260889 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d8272b77-64fd-4801-916c-48c21ba9a16e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:38.268177 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8272b77-64fd-4801-916c-48c21ba9a16e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:38.268804 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8272b77-64fd-4801-916c-48c21ba9a16e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:38.269587 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8272b77-64fd-4801-916c-48c21ba9a16e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:38.270015 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8272b77-64fd-4801-916c-48c21ba9a16e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:38.285101 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f895b3bd-4d2f-46dc-b0fa-b6a82a1c43ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:38.286566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f895b3bd-4d2f-46dc-b0fa-b6a82a1c43ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:38.296428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f895b3bd-4d2f-46dc-b0fa-b6a82a1c43ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:38.297144 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f895b3bd-4d2f-46dc-b0fa-b6a82a1c43ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:38.298098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f895b3bd-4d2f-46dc-b0fa-b6a82a1c43ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:38.298609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f895b3bd-4d2f-46dc-b0fa-b6a82a1c43ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:38.397196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d8272b77-64fd-4801-916c-48c21ba9a16e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.140886 Aug 04 14:00:38.398349 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 363/699] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:38 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:38.413792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f895b3bd-4d2f-46dc-b0fa-b6a82a1c43ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.132931 Aug 04 14:00:38.415334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 337/700] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:38 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:39.426671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8109f15c-8810-4649-929c-93b9c3d39bd1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:39.427670 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8109f15c-8810-4649-929c-93b9c3d39bd1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:39.435796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8109f15c-8810-4649-929c-93b9c3d39bd1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:39.436488 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8109f15c-8810-4649-929c-93b9c3d39bd1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:39.437059 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8109f15c-8810-4649-929c-93b9c3d39bd1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:39.437486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8109f15c-8810-4649-929c-93b9c3d39bd1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:39.452641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9635b9a3-30f4-4699-a50f-43df65dd1e19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:39.453677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9635b9a3-30f4-4699-a50f-43df65dd1e19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:39.461152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9635b9a3-30f4-4699-a50f-43df65dd1e19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:39.461601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9635b9a3-30f4-4699-a50f-43df65dd1e19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:39.462400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9635b9a3-30f4-4699-a50f-43df65dd1e19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:39.462834 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9635b9a3-30f4-4699-a50f-43df65dd1e19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:39.563590 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8109f15c-8810-4649-929c-93b9c3d39bd1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.140775 Aug 04 14:00:39.564169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 364/701] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:39 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:39.579287 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9635b9a3-30f4-4699-a50f-43df65dd1e19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.131468 Aug 04 14:00:39.579986 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 338/702] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:39 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:40.575510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e533ecc5-59fc-4ce9-a229-26b9512aec36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:40.576450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e533ecc5-59fc-4ce9-a229-26b9512aec36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:40.583167 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e533ecc5-59fc-4ce9-a229-26b9512aec36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:40.583615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e533ecc5-59fc-4ce9-a229-26b9512aec36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:40.584453 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e533ecc5-59fc-4ce9-a229-26b9512aec36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:40.584891 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e533ecc5-59fc-4ce9-a229-26b9512aec36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:40.592725 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c5241f5a-cb6e-430c-9c6d-7cd6e906cb31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:40.593767 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c5241f5a-cb6e-430c-9c6d-7cd6e906cb31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:40.600935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5241f5a-cb6e-430c-9c6d-7cd6e906cb31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:40.601389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5241f5a-cb6e-430c-9c6d-7cd6e906cb31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:40.602244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5241f5a-cb6e-430c-9c6d-7cd6e906cb31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:40.602687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5241f5a-cb6e-430c-9c6d-7cd6e906cb31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:40.705211 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e533ecc5-59fc-4ce9-a229-26b9512aec36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.134021 Aug 04 14:00:40.705870 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 365/703] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:40 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:40.735326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c5241f5a-cb6e-430c-9c6d-7cd6e906cb31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.146774 Aug 04 14:00:40.736507 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 339/704] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:40 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:41.718739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-95fc2a21-3938-41e2-a48b-2228b8de7c8b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:41.719749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-95fc2a21-3938-41e2-a48b-2228b8de7c8b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:41.726614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95fc2a21-3938-41e2-a48b-2228b8de7c8b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:41.727061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95fc2a21-3938-41e2-a48b-2228b8de7c8b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:41.727838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95fc2a21-3938-41e2-a48b-2228b8de7c8b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:41.728300 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95fc2a21-3938-41e2-a48b-2228b8de7c8b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:41.748112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5d55f00d-22a7-4cee-8dac-6233e2294687 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:41.749881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5d55f00d-22a7-4cee-8dac-6233e2294687 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:41.757169 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5d55f00d-22a7-4cee-8dac-6233e2294687 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:41.757699 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5d55f00d-22a7-4cee-8dac-6233e2294687 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:41.759511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5d55f00d-22a7-4cee-8dac-6233e2294687 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:41.759947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5d55f00d-22a7-4cee-8dac-6233e2294687 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:45.408826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5d55f00d-22a7-4cee-8dac-6233e2294687 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 3.665061 Aug 04 14:00:45.409564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 340/705] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:41 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 3667 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:45.726581 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-95fc2a21-3938-41e2-a48b-2228b8de7c8b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 4.012598 Aug 04 14:00:45.727249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 366/706] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:41 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 4014 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:46.422835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-05c1d7c9-606e-4b9e-806f-a603dbffcace tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:46.423955 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-05c1d7c9-606e-4b9e-806f-a603dbffcace tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:46.434033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05c1d7c9-606e-4b9e-806f-a603dbffcace tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:46.434665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05c1d7c9-606e-4b9e-806f-a603dbffcace tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:46.436360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05c1d7c9-606e-4b9e-806f-a603dbffcace tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:46.436815 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05c1d7c9-606e-4b9e-806f-a603dbffcace tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:46.556026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-05c1d7c9-606e-4b9e-806f-a603dbffcace tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.139058 Aug 04 14:00:46.557018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 341/707] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:46 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:46.739799 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-da8e6035-7a0e-4ced-91ca-c833711ccbd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:46.742698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-da8e6035-7a0e-4ced-91ca-c833711ccbd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:46.754189 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-da8e6035-7a0e-4ced-91ca-c833711ccbd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:46.754633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-da8e6035-7a0e-4ced-91ca-c833711ccbd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:46.755429 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-da8e6035-7a0e-4ced-91ca-c833711ccbd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:46.755862 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-da8e6035-7a0e-4ced-91ca-c833711ccbd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:46.892679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-da8e6035-7a0e-4ced-91ca-c833711ccbd4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.156571 Aug 04 14:00:46.893474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 367/708] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:46 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:47.335784 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4f690ff8-673f-41e5-8603-c963baab7c9d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "445c7b82-4669-4334-ae16-3cb0a3150b8c"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:47.338118 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4f690ff8-673f-41e5-8603-c963baab7c9d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:47.350644 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4f690ff8-673f-41e5-8603-c963baab7c9d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:47.351419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4f690ff8-673f-41e5-8603-c963baab7c9d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:47.352851 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4f690ff8-673f-41e5-8603-c963baab7c9d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:47.353608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4f690ff8-673f-41e5-8603-c963baab7c9d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:47.576294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-234224f4-9b06-45df-956d-735e313f57cb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:47.577785 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-234224f4-9b06-45df-956d-735e313f57cb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:47.591921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-234224f4-9b06-45df-956d-735e313f57cb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:47.593112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-234224f4-9b06-45df-956d-735e313f57cb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:47.596736 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-234224f4-9b06-45df-956d-735e313f57cb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:47.598259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-234224f4-9b06-45df-956d-735e313f57cb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:47.739270 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4f690ff8-673f-41e5-8603-c963baab7c9d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "POST /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411612 Aug 04 14:00:47.744024 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 342/709] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 14:00:47 2021] POST /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:47.754888 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-234224f4-9b06-45df-956d-735e313f57cb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.185251 Aug 04 14:00:47.755648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 368/710] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:47 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:47.911112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-541c6673-0c35-4f09-95e1-332d420b4dac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:47.914469 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-541c6673-0c35-4f09-95e1-332d420b4dac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:47.928971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-541c6673-0c35-4f09-95e1-332d420b4dac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:47.929751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-541c6673-0c35-4f09-95e1-332d420b4dac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:47.931104 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-541c6673-0c35-4f09-95e1-332d420b4dac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:47.931864 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-541c6673-0c35-4f09-95e1-332d420b4dac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:48.076797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-541c6673-0c35-4f09-95e1-332d420b4dac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.174269 Aug 04 14:00:48.077468 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 343/711] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:47 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:48.769706 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9780a21d-a7fe-426d-ad35-7eb9fa38703f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:48.771806 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9780a21d-a7fe-426d-ad35-7eb9fa38703f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:48.780098 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9780a21d-a7fe-426d-ad35-7eb9fa38703f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:48.780720 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9780a21d-a7fe-426d-ad35-7eb9fa38703f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:48.781907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9780a21d-a7fe-426d-ad35-7eb9fa38703f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:48.782434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9780a21d-a7fe-426d-ad35-7eb9fa38703f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:48.883869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9780a21d-a7fe-426d-ad35-7eb9fa38703f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 28844 microversion: 2.20 time: 0.119369 Aug 04 14:00:48.885775 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 369/712] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:48 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 28844 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:49.090219 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5e2ad761-c907-489e-98a3-edc87fd7ff50 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:49.092233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5e2ad761-c907-489e-98a3-edc87fd7ff50 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:49.100597 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5e2ad761-c907-489e-98a3-edc87fd7ff50 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:49.101165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5e2ad761-c907-489e-98a3-edc87fd7ff50 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:49.102225 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5e2ad761-c907-489e-98a3-edc87fd7ff50 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:49.102811 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5e2ad761-c907-489e-98a3-edc87fd7ff50 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:49.208611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5e2ad761-c907-489e-98a3-edc87fd7ff50 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 28675 microversion: 2.1 time: 0.122535 Aug 04 14:00:49.209163 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 344/713] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:49 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 28675 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:49.865324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8e3652c3-5cd2-4e33-ab79-6805eae32613 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:49.866358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8e3652c3-5cd2-4e33-ab79-6805eae32613 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:49.878136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e3652c3-5cd2-4e33-ab79-6805eae32613 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:49.878945 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e3652c3-5cd2-4e33-ab79-6805eae32613 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:49.880402 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e3652c3-5cd2-4e33-ab79-6805eae32613 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:49.881206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e3652c3-5cd2-4e33-ab79-6805eae32613 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:49.900867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4c9ff4f6-af77-4d4f-a841-505d34b0565d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:49.902426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4c9ff4f6-af77-4d4f-a841-505d34b0565d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:49.912125 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8e3652c3-5cd2-4e33-ab79-6805eae32613 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Going to try to terminate instance {{(pid=107822) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:00:49.912321 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c9ff4f6-af77-4d4f-a841-505d34b0565d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:49.912576 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c9ff4f6-af77-4d4f-a841-505d34b0565d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:49.913373 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c9ff4f6-af77-4d4f-a841-505d34b0565d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:49.913805 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c9ff4f6-af77-4d4f-a841-505d34b0565d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:50.014295 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8e3652c3-5cd2-4e33-ab79-6805eae32613 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 204 len: 0 microversion: 2.1 time: 0.155794 Aug 04 14:00:50.015018 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 370/714] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:00:49 2021] DELETE /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:00:50.023134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-34e97520-8be8-4dc5-b2da-3774fba89fce tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:50.023840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-34e97520-8be8-4dc5-b2da-3774fba89fce tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:50.030664 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-34e97520-8be8-4dc5-b2da-3774fba89fce tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:50.031106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-34e97520-8be8-4dc5-b2da-3774fba89fce tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:50.031893 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-34e97520-8be8-4dc5-b2da-3774fba89fce tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:50.032376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-34e97520-8be8-4dc5-b2da-3774fba89fce tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:50.045406 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4c9ff4f6-af77-4d4f-a841-505d34b0565d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 29815 microversion: 2.20 time: 0.151037 Aug 04 14:00:50.046087 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 345/715] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:49 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 29815 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:50.185497 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-34e97520-8be8-4dc5-b2da-3774fba89fce tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:50.191028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-34e97520-8be8-4dc5-b2da-3774fba89fce tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1508 microversion: 2.1 time: 0.171745 Aug 04 14:00:50.202277 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 371/716] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:50 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:50.221703 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4b818292-a85d-4dec-9a5d-d7b44d2df1d7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:50.222951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4b818292-a85d-4dec-9a5d-d7b44d2df1d7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:50.230120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4b818292-a85d-4dec-9a5d-d7b44d2df1d7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:50.231607 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4b818292-a85d-4dec-9a5d-d7b44d2df1d7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:50.232673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4b818292-a85d-4dec-9a5d-d7b44d2df1d7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:50.233198 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4b818292-a85d-4dec-9a5d-d7b44d2df1d7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:50.371508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4b818292-a85d-4dec-9a5d-d7b44d2df1d7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 29758 microversion: 2.1 time: 0.153613 Aug 04 14:00:50.372181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 346/717] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:50 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 29758 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:51.058454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-39ff3e4b-1caf-4f33-a81d-077c924a8ca2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:51.059513 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-39ff3e4b-1caf-4f33-a81d-077c924a8ca2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:51.066423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-39ff3e4b-1caf-4f33-a81d-077c924a8ca2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:51.066868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-39ff3e4b-1caf-4f33-a81d-077c924a8ca2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:51.067739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-39ff3e4b-1caf-4f33-a81d-077c924a8ca2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:51.068168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-39ff3e4b-1caf-4f33-a81d-077c924a8ca2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:51.185699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-39ff3e4b-1caf-4f33-a81d-077c924a8ca2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 31077 microversion: 2.20 time: 0.130991 Aug 04 14:00:51.186383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 372/718] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:51 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 31077 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:51.211802 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b695ea9a-1bfe-4581-ab44-18317026f1d7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:51.212676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b695ea9a-1bfe-4581-ab44-18317026f1d7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:51.220600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b695ea9a-1bfe-4581-ab44-18317026f1d7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:51.221098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b695ea9a-1bfe-4581-ab44-18317026f1d7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:51.221887 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b695ea9a-1bfe-4581-ab44-18317026f1d7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:51.222775 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b695ea9a-1bfe-4581-ab44-18317026f1d7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:51.381942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b695ea9a-1bfe-4581-ab44-18317026f1d7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:51.391023 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-858ef5c6-081e-4e8c-adf6-9738149b38b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:51.392978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-858ef5c6-081e-4e8c-adf6-9738149b38b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:51.394907 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b695ea9a-1bfe-4581-ab44-18317026f1d7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1508 microversion: 2.1 time: 0.187454 Aug 04 14:00:51.395684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 347/719] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:51 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:51.405302 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-858ef5c6-081e-4e8c-adf6-9738149b38b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:51.406290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-858ef5c6-081e-4e8c-adf6-9738149b38b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:51.407307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-858ef5c6-081e-4e8c-adf6-9738149b38b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:51.408029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-858ef5c6-081e-4e8c-adf6-9738149b38b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:51.539528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-858ef5c6-081e-4e8c-adf6-9738149b38b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 30860 microversion: 2.1 time: 0.158011 Aug 04 14:00:51.540556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 373/720] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:51 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 30860 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:52.200969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ca770019-a27f-4b05-bd32-cb58a146a817 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:52.202567 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ca770019-a27f-4b05-bd32-cb58a146a817 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:52.214020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca770019-a27f-4b05-bd32-cb58a146a817 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:52.214831 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca770019-a27f-4b05-bd32-cb58a146a817 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:52.216360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca770019-a27f-4b05-bd32-cb58a146a817 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:52.217142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca770019-a27f-4b05-bd32-cb58a146a817 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:52.357214 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ca770019-a27f-4b05-bd32-cb58a146a817 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 32195 microversion: 2.20 time: 0.161760 Aug 04 14:00:52.358638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 348/721] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:52 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 32195 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:52.417773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-737f68d9-d29b-43bf-b0cd-0198dc1a432f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:52.419207 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-737f68d9-d29b-43bf-b0cd-0198dc1a432f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:52.427763 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-737f68d9-d29b-43bf-b0cd-0198dc1a432f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:52.428369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-737f68d9-d29b-43bf-b0cd-0198dc1a432f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:52.429181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-737f68d9-d29b-43bf-b0cd-0198dc1a432f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:52.429622 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-737f68d9-d29b-43bf-b0cd-0198dc1a432f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:52.583638 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-737f68d9-d29b-43bf-b0cd-0198dc1a432f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:52.593262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-737f68d9-d29b-43bf-b0cd-0198dc1a432f tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1508 microversion: 2.1 time: 0.183077 Aug 04 14:00:52.594034 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 374/722] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:52 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:52.611402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-daf36c2a-3842-4d8d-96c4-cdb9500f02fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:52.613063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-daf36c2a-3842-4d8d-96c4-cdb9500f02fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:52.619800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-daf36c2a-3842-4d8d-96c4-cdb9500f02fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:52.620430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-daf36c2a-3842-4d8d-96c4-cdb9500f02fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:52.621789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-daf36c2a-3842-4d8d-96c4-cdb9500f02fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:52.622428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-daf36c2a-3842-4d8d-96c4-cdb9500f02fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:52.755133 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-daf36c2a-3842-4d8d-96c4-cdb9500f02fa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 32081 microversion: 2.1 time: 0.151285 Aug 04 14:00:52.756106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 349/723] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:52 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 32081 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:53.375246 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d2d4ed8b-9646-48b8-b67b-e2510cf99b8c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:53.376387 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d2d4ed8b-9646-48b8-b67b-e2510cf99b8c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:53.383333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d2d4ed8b-9646-48b8-b67b-e2510cf99b8c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:53.383780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d2d4ed8b-9646-48b8-b67b-e2510cf99b8c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:53.384608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d2d4ed8b-9646-48b8-b67b-e2510cf99b8c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:53.385034 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d2d4ed8b-9646-48b8-b67b-e2510cf99b8c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:53.507367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d2d4ed8b-9646-48b8-b67b-e2510cf99b8c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 33125 microversion: 2.20 time: 0.137896 Aug 04 14:00:53.513329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 375/724] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:53 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 33125 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:53.614781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-53e1505b-1b3b-451a-94dd-4018a535bf4b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:53.616052 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-53e1505b-1b3b-451a-94dd-4018a535bf4b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:53.629021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-53e1505b-1b3b-451a-94dd-4018a535bf4b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:53.629774 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-53e1505b-1b3b-451a-94dd-4018a535bf4b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:53.631250 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-53e1505b-1b3b-451a-94dd-4018a535bf4b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:53.632068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-53e1505b-1b3b-451a-94dd-4018a535bf4b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:53.774647 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-692e8a0b-01c2-450b-8f51-daab40c6176c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:53.775985 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-692e8a0b-01c2-450b-8f51-daab40c6176c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:53.788633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-692e8a0b-01c2-450b-8f51-daab40c6176c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:53.789476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-692e8a0b-01c2-450b-8f51-daab40c6176c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:53.790836 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-692e8a0b-01c2-450b-8f51-daab40c6176c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:53.791295 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-692e8a0b-01c2-450b-8f51-daab40c6176c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:53.913179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-53e1505b-1b3b-451a-94dd-4018a535bf4b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:53.922614 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-53e1505b-1b3b-451a-94dd-4018a535bf4b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1508 microversion: 2.1 time: 0.314401 Aug 04 14:00:53.928320 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 350/725] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:53 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:53.950790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-692e8a0b-01c2-450b-8f51-daab40c6176c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 33082 microversion: 2.1 time: 0.185433 Aug 04 14:00:53.951829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 376/726] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:53 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 33082 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:54.381288 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-8f473e57-43c0-4931-aca3-0c69e1a30366 req-1b9133f1-8090-41f9-b960-1ab9874ef267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1daa517-619e-4605-8c20-906b075afd41", "name": "network-vif-deleted", "tag": "0e6069d0-3962-435f-bbec-6c8cd1f4930d"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:54.383194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:00:54.383194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:00:54.391257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-8f473e57-43c0-4931-aca3-0c69e1a30366 req-1b9133f1-8090-41f9-b960-1ab9874ef267 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:54.391964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-8f473e57-43c0-4931-aca3-0c69e1a30366 req-1b9133f1-8090-41f9-b960-1ab9874ef267 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:54.405552 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-8f473e57-43c0-4931-aca3-0c69e1a30366 req-1b9133f1-8090-41f9-b960-1ab9874ef267 service nova] Creating event network-vif-deleted:0e6069d0-3962-435f-bbec-6c8cd1f4930d for instance d1daa517-619e-4605-8c20-906b075afd41 on hv-cinder-79264 Aug 04 14:00:54.411426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-8f473e57-43c0-4931-aca3-0c69e1a30366 req-1b9133f1-8090-41f9-b960-1ab9874ef267 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033573 Aug 04 14:00:54.413263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 351/727] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:00:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:54.526878 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ccf86cae-f265-4c72-a468-44aeee21ab15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:54.531077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ccf86cae-f265-4c72-a468-44aeee21ab15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:54.545573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ccf86cae-f265-4c72-a468-44aeee21ab15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:54.546575 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ccf86cae-f265-4c72-a468-44aeee21ab15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:54.548431 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ccf86cae-f265-4c72-a468-44aeee21ab15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:54.549245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ccf86cae-f265-4c72-a468-44aeee21ab15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:54.718105 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ccf86cae-f265-4c72-a468-44aeee21ab15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 33690 microversion: 2.20 time: 0.199678 Aug 04 14:00:54.719089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 377/728] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:54 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 33690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:54.949781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:54.951011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:54.960112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:54.960112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:54.960112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:54.960752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:54.969108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-00615455-4af0-4196-901c-0a104c63983e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:54.970753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-00615455-4af0-4196-901c-0a104c63983e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:54.981434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00615455-4af0-4196-901c-0a104c63983e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:54.982113 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00615455-4af0-4196-901c-0a104c63983e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:54.983480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00615455-4af0-4196-901c-0a104c63983e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:54.984263 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00615455-4af0-4196-901c-0a104c63983e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:55.011122 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:55.012410 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:55.013151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lazy-loading 'fault' on Instance uuid d1daa517-619e-4605-8c20-906b075afd41 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:00:55.065098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:55.077697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fc8fd62b-4868-4d1e-a74a-82dcad255c0b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 200 len: 1312 microversion: 2.1 time: 0.134130 Aug 04 14:00:55.078526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 352/729] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:54 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 1312 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:55.151381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-00615455-4af0-4196-901c-0a104c63983e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 33509 microversion: 2.1 time: 0.188300 Aug 04 14:00:55.152092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 378/730] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:54 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 33509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:55.732801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-033bf415-60a3-4441-9f00-52b992c4fa52 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:55.734029 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-033bf415-60a3-4441-9f00-52b992c4fa52 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:55.740661 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-033bf415-60a3-4441-9f00-52b992c4fa52 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:55.741107 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-033bf415-60a3-4441-9f00-52b992c4fa52 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:55.741883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-033bf415-60a3-4441-9f00-52b992c4fa52 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:55.742312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-033bf415-60a3-4441-9f00-52b992c4fa52 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:55.859457 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-033bf415-60a3-4441-9f00-52b992c4fa52 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 34251 microversion: 2.20 time: 0.131599 Aug 04 14:00:55.861146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 353/731] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:55 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 34251 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:56.100460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:56.101835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: d1daa517-619e-4605-8c20-906b075afd41] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:56.112841 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.114323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.116658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.119426 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.144150 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] HTTP exception thrown: Instance d1daa517-619e-4605-8c20-906b075afd41 could not be found. Aug 04 14:00:56.144807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Returning 404 to user: Instance d1daa517-619e-4605-8c20-906b075afd41 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:00:56.145646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e823a158-fa55-49fe-8463-27902c02b169 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41" status: 404 len: 111 microversion: 2.1 time: 0.052119 Aug 04 14:00:56.146203 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 379/732] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:56 2021] GET /compute/v2.1/servers/d1daa517-619e-4605-8c20-906b075afd41 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:00:56.157655 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-03e0d7ee-ed8b-4aff-9c96-eca4ce06c2d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:56.158235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-03e0d7ee-ed8b-4aff-9c96-eca4ce06c2d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:56.164778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-020be389-f120-4489-ac18-a43cadafa198 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:56.165710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-020be389-f120-4489-ac18-a43cadafa198 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:56.165855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-03e0d7ee-ed8b-4aff-9c96-eca4ce06c2d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.166232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-03e0d7ee-ed8b-4aff-9c96-eca4ce06c2d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.167013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-03e0d7ee-ed8b-4aff-9c96-eca4ce06c2d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.167442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-03e0d7ee-ed8b-4aff-9c96-eca4ce06c2d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.172510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-020be389-f120-4489-ac18-a43cadafa198 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.172998 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-020be389-f120-4489-ac18-a43cadafa198 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.173843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-020be389-f120-4489-ac18-a43cadafa198 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.174611 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-020be389-f120-4489-ac18-a43cadafa198 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.198680 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-03e0d7ee-ed8b-4aff-9c96-eca4ce06c2d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:00:56.289296 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-020be389-f120-4489-ac18-a43cadafa198 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 34365 microversion: 2.1 time: 0.128379 Aug 04 14:00:56.290709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 380/733] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:56 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 34365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:00:56.292573 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-03e0d7ee-ed8b-4aff-9c96-eca4ce06c2d1 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 204 len: 0 microversion: 2.1 time: 0.141601 Aug 04 14:00:56.298031 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 354/734] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:00:56 2021] DELETE /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:00:56.310355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4ce8a7cd-c569-4630-a1c9-34aa492451c7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:56.311399 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4ce8a7cd-c569-4630-a1c9-34aa492451c7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:56.326460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4ce8a7cd-c569-4630-a1c9-34aa492451c7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.327539 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4ce8a7cd-c569-4630-a1c9-34aa492451c7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.328892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4ce8a7cd-c569-4630-a1c9-34aa492451c7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.329598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4ce8a7cd-c569-4630-a1c9-34aa492451c7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.545631 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4ce8a7cd-c569-4630-a1c9-34aa492451c7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:56.553490 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4ce8a7cd-c569-4630-a1c9-34aa492451c7 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.249231 Aug 04 14:00:56.554923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 381/735] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:56 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:56.590691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7e8741df-9de0-467c-89e2-6fd666601e41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:56.591383 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7e8741df-9de0-467c-89e2-6fd666601e41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:56.597434 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7e8741df-9de0-467c-89e2-6fd666601e41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.597884 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7e8741df-9de0-467c-89e2-6fd666601e41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.598680 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7e8741df-9de0-467c-89e2-6fd666601e41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.599185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7e8741df-9de0-467c-89e2-6fd666601e41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.691305 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-7e8741df-9de0-467c-89e2-6fd666601e41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lazy-loading 'services' on Instance uuid 08dc1422-f4fa-4416-9b79-15b3c7007585 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:00:56.759412 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7e8741df-9de0-467c-89e2-6fd666601e41 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585/os-volume_attachments/445c7b82-4669-4334-ae16-3cb0a3150b8c" status: 202 len: 0 microversion: 2.1 time: 0.172856 Aug 04 14:00:56.760044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 355/736] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:00:56 2021] DELETE /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585/os-volume_attachments/445c7b82-4669-4334-ae16-3cb0a3150b8c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:56.871078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1de39818-089b-4f58-bfb0-6bdad25a125b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:56.872103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1de39818-089b-4f58-bfb0-6bdad25a125b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:56.878158 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1de39818-089b-4f58-bfb0-6bdad25a125b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.878655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1de39818-089b-4f58-bfb0-6bdad25a125b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:56.879441 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1de39818-089b-4f58-bfb0-6bdad25a125b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:56.880054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1de39818-089b-4f58-bfb0-6bdad25a125b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:57.022744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1de39818-089b-4f58-bfb0-6bdad25a125b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 35080 microversion: 2.20 time: 0.155190 Aug 04 14:00:57.023462 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 382/737] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:56 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 35080 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:57.304562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-240ea24e-0a21-46fc-850e-d668b99b9e4f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:57.305633 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-240ea24e-0a21-46fc-850e-d668b99b9e4f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:57.312882 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-240ea24e-0a21-46fc-850e-d668b99b9e4f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:57.313326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-240ea24e-0a21-46fc-850e-d668b99b9e4f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:57.314208 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-240ea24e-0a21-46fc-850e-d668b99b9e4f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:57.314631 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-240ea24e-0a21-46fc-850e-d668b99b9e4f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:57.429829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-240ea24e-0a21-46fc-850e-d668b99b9e4f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 35006 microversion: 2.1 time: 0.129950 Aug 04 14:00:57.430849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 356/738] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:57 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 35006 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:57.572981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3d6527bf-475e-454f-a3ac-0e411ba87543 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:57.574222 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3d6527bf-475e-454f-a3ac-0e411ba87543 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:57.587210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d6527bf-475e-454f-a3ac-0e411ba87543 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:57.588137 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d6527bf-475e-454f-a3ac-0e411ba87543 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:57.589544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d6527bf-475e-454f-a3ac-0e411ba87543 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:57.590335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d6527bf-475e-454f-a3ac-0e411ba87543 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:57.624082 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-726432339", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "8cf8a406-b1f1-48fb-9af7-a87613bf1591"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:57.686246 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] validate_networks() for [('8cf8a406-b1f1-48fb-9af7-a87613bf1591', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:00:57.757505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3d6527bf-475e-454f-a3ac-0e411ba87543 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:57.767708 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3d6527bf-475e-454f-a3ac-0e411ba87543 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.198949 Aug 04 14:00:57.768640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 383/739] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:57 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:58.036769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-891bce5e-b503-4a92-96c9-22263bd09552 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:58.037576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-891bce5e-b503-4a92-96c9-22263bd09552 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:58.044758 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-891bce5e-b503-4a92-96c9-22263bd09552 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:58.045215 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-891bce5e-b503-4a92-96c9-22263bd09552 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:58.046025 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-891bce5e-b503-4a92-96c9-22263bd09552 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:58.046466 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-891bce5e-b503-4a92-96c9-22263bd09552 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:58.063915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:00:58.064377 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:00:58.064855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:00:58.065290 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:00:58.066024 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:00:58.078392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:58.079220 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:58.081349 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:58.081349 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:58.099520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Getting quotas for project 46936a5606ce4e148713e2709548faaa. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:00:58.103769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Getting quotas for user 9d38a2823d944bc8bace34cc344960e2 and project 46936a5606ce4e148713e2709548faaa. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:00:58.115308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:00:58.117789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:00:58.178388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9ddf060e-d80e-4d7d-981c-525792a535cf tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559048 Aug 04 14:00:58.179055 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 357/740] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:00:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:00:58.191379 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e7c88783-3abe-4867-b85a-13bf7c1e7381 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:58.192587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e7c88783-3abe-4867-b85a-13bf7c1e7381 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:58.230633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-891bce5e-b503-4a92-96c9-22263bd09552 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 35770 microversion: 2.20 time: 0.197398 Aug 04 14:00:58.231646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 384/741] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:58 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 35770 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:00:58.261314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e7c88783-3abe-4867-b85a-13bf7c1e7381 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:58.269191 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e7c88783-3abe-4867-b85a-13bf7c1e7381 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1218 microversion: 2.1 time: 0.082970 Aug 04 14:00:58.269783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 358/742] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:58 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:58.446533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f53db129-85c6-428a-96bd-fec824b3d820 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:58.447953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f53db129-85c6-428a-96bd-fec824b3d820 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:58.456795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f53db129-85c6-428a-96bd-fec824b3d820 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:58.457373 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f53db129-85c6-428a-96bd-fec824b3d820 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:58.458329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f53db129-85c6-428a-96bd-fec824b3d820 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:58.458980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f53db129-85c6-428a-96bd-fec824b3d820 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:58.597280 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f53db129-85c6-428a-96bd-fec824b3d820 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 35717 microversion: 2.1 time: 0.157430 Aug 04 14:00:58.598916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 385/743] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:58 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 35717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:58.792664 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b83a910b-c889-4721-8730-fd02721da74b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:58.793483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b83a910b-c889-4721-8730-fd02721da74b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:58.801419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b83a910b-c889-4721-8730-fd02721da74b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:58.801994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b83a910b-c889-4721-8730-fd02721da74b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:58.802761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b83a910b-c889-4721-8730-fd02721da74b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:58.803243 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b83a910b-c889-4721-8730-fd02721da74b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:58.957377 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b83a910b-c889-4721-8730-fd02721da74b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:58.970244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b83a910b-c889-4721-8730-fd02721da74b tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.181283 Aug 04 14:00:58.970982 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 359/744] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:58 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:59.243958 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2a4b987e-d71f-46f3-b0d2-c36e1a3724a1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:59.245017 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2a4b987e-d71f-46f3-b0d2-c36e1a3724a1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:59.252900 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2a4b987e-d71f-46f3-b0d2-c36e1a3724a1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:59.253344 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2a4b987e-d71f-46f3-b0d2-c36e1a3724a1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:59.254142 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2a4b987e-d71f-46f3-b0d2-c36e1a3724a1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:59.254575 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2a4b987e-d71f-46f3-b0d2-c36e1a3724a1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:59.287446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ac55e274-d20c-4a70-9c85-976d71086888 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:59.288054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ac55e274-d20c-4a70-9c85-976d71086888 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:59.294915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ac55e274-d20c-4a70-9c85-976d71086888 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:59.295355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ac55e274-d20c-4a70-9c85-976d71086888 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:59.296278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ac55e274-d20c-4a70-9c85-976d71086888 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:59.296630 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ac55e274-d20c-4a70-9c85-976d71086888 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:59.364498 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ac55e274-d20c-4a70-9c85-976d71086888 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:59.373738 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ac55e274-d20c-4a70-9c85-976d71086888 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1270 microversion: 2.1 time: 0.090498 Aug 04 14:00:59.374372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 360/745] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:59 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:59.415442 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2a4b987e-d71f-46f3-b0d2-c36e1a3724a1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 36714 microversion: 2.20 time: 0.175577 Aug 04 14:00:59.416095 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 386/746] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:00:59 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 36714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:59.609986 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c39b41a5-7547-48d3-9ed3-9cc8de12e0c6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:59.610990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c39b41a5-7547-48d3-9ed3-9cc8de12e0c6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:59.617077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c39b41a5-7547-48d3-9ed3-9cc8de12e0c6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:59.617526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c39b41a5-7547-48d3-9ed3-9cc8de12e0c6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:59.618310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c39b41a5-7547-48d3-9ed3-9cc8de12e0c6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:59.618761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c39b41a5-7547-48d3-9ed3-9cc8de12e0c6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:59.755460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c39b41a5-7547-48d3-9ed3-9cc8de12e0c6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 36614 microversion: 2.1 time: 0.149048 Aug 04 14:00:59.756119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 361/747] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:00:59 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 36614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:59.987821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7a3e4fa9-428c-480a-a770-5a54b987b440 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:59.988553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7a3e4fa9-428c-480a-a770-5a54b987b440 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:00:59.994834 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7a3e4fa9-428c-480a-a770-5a54b987b440 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:59.995285 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7a3e4fa9-428c-480a-a770-5a54b987b440 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:00:59.996591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7a3e4fa9-428c-480a-a770-5a54b987b440 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:00:59.997035 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7a3e4fa9-428c-480a-a770-5a54b987b440 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.141190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7a3e4fa9-428c-480a-a770-5a54b987b440 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:00.142269 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-db06458e-cffe-41fd-9db1-0aaea516bf7e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:00.143357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-db06458e-cffe-41fd-9db1-0aaea516bf7e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:00.149171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7a3e4fa9-428c-480a-a770-5a54b987b440 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.165355 Aug 04 14:01:00.150008 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 387/748] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:00:59 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:00.153525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-db06458e-cffe-41fd-9db1-0aaea516bf7e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.154236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-db06458e-cffe-41fd-9db1-0aaea516bf7e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.154724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-db06458e-cffe-41fd-9db1-0aaea516bf7e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.155158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-db06458e-cffe-41fd-9db1-0aaea516bf7e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.182589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-db06458e-cffe-41fd-9db1-0aaea516bf7e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:01:00.270274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-db06458e-cffe-41fd-9db1-0aaea516bf7e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 204 len: 0 microversion: 2.1 time: 0.135662 Aug 04 14:01:00.274420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 362/749] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:01:00 2021] DELETE /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:01:00.281754 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f4f21c36-e17b-472e-9f1d-fdc0f1e96e94 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:00.285489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f4f21c36-e17b-472e-9f1d-fdc0f1e96e94 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:00.297152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f4f21c36-e17b-472e-9f1d-fdc0f1e96e94 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.297958 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f4f21c36-e17b-472e-9f1d-fdc0f1e96e94 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.299455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f4f21c36-e17b-472e-9f1d-fdc0f1e96e94 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.300357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f4f21c36-e17b-472e-9f1d-fdc0f1e96e94 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.393039 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7cf824e1-bf35-40b9-b8f9-ff08f08cf4a5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:00.394025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7cf824e1-bf35-40b9-b8f9-ff08f08cf4a5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:00.400249 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7cf824e1-bf35-40b9-b8f9-ff08f08cf4a5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.400828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7cf824e1-bf35-40b9-b8f9-ff08f08cf4a5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.401743 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7cf824e1-bf35-40b9-b8f9-ff08f08cf4a5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.402381 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7cf824e1-bf35-40b9-b8f9-ff08f08cf4a5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.433591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f4f21c36-e17b-472e-9f1d-fdc0f1e96e94 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:00.442657 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f4f21c36-e17b-472e-9f1d-fdc0f1e96e94 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1514 microversion: 2.1 time: 0.166441 Aug 04 14:01:00.443235 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 388/750] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:00 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:00.458553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1fa77bcb-f48f-40d6-81eb-c60c1e1432e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:00.460107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1fa77bcb-f48f-40d6-81eb-c60c1e1432e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:00.468088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1fa77bcb-f48f-40d6-81eb-c60c1e1432e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.468749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1fa77bcb-f48f-40d6-81eb-c60c1e1432e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.469979 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1fa77bcb-f48f-40d6-81eb-c60c1e1432e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.470634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1fa77bcb-f48f-40d6-81eb-c60c1e1432e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.586816 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1fa77bcb-f48f-40d6-81eb-c60c1e1432e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 37457 microversion: 2.20 time: 0.132966 Aug 04 14:01:00.587476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 389/751] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:01:00 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 37457 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:00.632437 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7cf824e1-bf35-40b9-b8f9-ff08f08cf4a5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:00.642152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7cf824e1-bf35-40b9-b8f9-ff08f08cf4a5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.253563 Aug 04 14:01:00.642926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 363/752] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:00 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:00.769689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f3ef5ce7-02d2-4fc5-a434-5c37c6971108 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:00.770969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f3ef5ce7-02d2-4fc5-a434-5c37c6971108 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:00.779793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f3ef5ce7-02d2-4fc5-a434-5c37c6971108 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.780436 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f3ef5ce7-02d2-4fc5-a434-5c37c6971108 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.781372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f3ef5ce7-02d2-4fc5-a434-5c37c6971108 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.781810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f3ef5ce7-02d2-4fc5-a434-5c37c6971108 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.880701 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-a6ab3a70-7b2c-446a-82d8-9caa86205095 req-d8696a09-dff9-45fc-ad88-398fd20b959f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2690b010-926e-4e5e-ae24-f0e14a968d86", "tag": "e58a7a3a-6a1b-406f-bc99-b15c2b8d7059"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:00.882137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:00.882137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:01:00.890411 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-a6ab3a70-7b2c-446a-82d8-9caa86205095 req-d8696a09-dff9-45fc-ad88-398fd20b959f service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:00.890865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-a6ab3a70-7b2c-446a-82d8-9caa86205095 req-d8696a09-dff9-45fc-ad88-398fd20b959f service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:00.904954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-a6ab3a70-7b2c-446a-82d8-9caa86205095 req-d8696a09-dff9-45fc-ad88-398fd20b959f service nova] Creating event network-changed:e58a7a3a-6a1b-406f-bc99-b15c2b8d7059 for instance 2690b010-926e-4e5e-ae24-f0e14a968d86 on hv-cinder-79264 Aug 04 14:01:00.909801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-a6ab3a70-7b2c-446a-82d8-9caa86205095 req-d8696a09-dff9-45fc-ad88-398fd20b959f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034034 Aug 04 14:01:00.910698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 364/753] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:01:00.915915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f3ef5ce7-02d2-4fc5-a434-5c37c6971108 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 37613 microversion: 2.1 time: 0.150918 Aug 04 14:01:00.918716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 390/754] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:01:00 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 37613 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:01:01.170218 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4b2e4ec3-c7a7-492f-9aba-dca7bb2d39f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:01.170880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4b2e4ec3-c7a7-492f-9aba-dca7bb2d39f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:01.177358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4b2e4ec3-c7a7-492f-9aba-dca7bb2d39f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.177800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4b2e4ec3-c7a7-492f-9aba-dca7bb2d39f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.178573 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4b2e4ec3-c7a7-492f-9aba-dca7bb2d39f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.178997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4b2e4ec3-c7a7-492f-9aba-dca7bb2d39f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.461710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2a4769d4-8b9f-4f71-ae20-8a6f8ed7c3c3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:01.463226 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2a4769d4-8b9f-4f71-ae20-8a6f8ed7c3c3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:01.471798 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2a4769d4-8b9f-4f71-ae20-8a6f8ed7c3c3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.472456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2a4769d4-8b9f-4f71-ae20-8a6f8ed7c3c3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.473366 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2a4769d4-8b9f-4f71-ae20-8a6f8ed7c3c3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.473789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2a4769d4-8b9f-4f71-ae20-8a6f8ed7c3c3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.612888 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4b2e4ec3-c7a7-492f-9aba-dca7bb2d39f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:01.621676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4b2e4ec3-c7a7-492f-9aba-dca7bb2d39f4 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.456135 Aug 04 14:01:01.622476 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 365/755] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:01 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:01.627963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e2699291-c163-423e-811b-0e2bfa20c7c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:01.629199 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e2699291-c163-423e-811b-0e2bfa20c7c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:01.637416 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e2699291-c163-423e-811b-0e2bfa20c7c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.638265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e2699291-c163-423e-811b-0e2bfa20c7c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.639121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e2699291-c163-423e-811b-0e2bfa20c7c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.639581 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e2699291-c163-423e-811b-0e2bfa20c7c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.854681 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2a4769d4-8b9f-4f71-ae20-8a6f8ed7c3c3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:01.864832 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2a4769d4-8b9f-4f71-ae20-8a6f8ed7c3c3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1514 microversion: 2.1 time: 0.407587 Aug 04 14:01:01.865418 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 391/756] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:01 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1514 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:01.865644 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e2699291-c163-423e-811b-0e2bfa20c7c6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 38371 microversion: 2.20 time: 0.241560 Aug 04 14:01:01.867644 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 366/757] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:01:01 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 38371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:01.874503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8cc22ab4-c015-4969-9cdb-f97239c7d3c2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:01.874503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8cc22ab4-c015-4969-9cdb-f97239c7d3c2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:01.880422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8cc22ab4-c015-4969-9cdb-f97239c7d3c2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.880871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8cc22ab4-c015-4969-9cdb-f97239c7d3c2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.881658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8cc22ab4-c015-4969-9cdb-f97239c7d3c2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.882090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8cc22ab4-c015-4969-9cdb-f97239c7d3c2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.929561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b5bc0917-f8f8-4190-8efd-b01aefb86547 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:01.930563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b5bc0917-f8f8-4190-8efd-b01aefb86547 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:01.938204 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b5bc0917-f8f8-4190-8efd-b01aefb86547 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.938647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b5bc0917-f8f8-4190-8efd-b01aefb86547 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:01.939434 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b5bc0917-f8f8-4190-8efd-b01aefb86547 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:01.939866 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b5bc0917-f8f8-4190-8efd-b01aefb86547 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:02.043269 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8cc22ab4-c015-4969-9cdb-f97239c7d3c2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:02.051965 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8cc22ab4-c015-4969-9cdb-f97239c7d3c2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.185359 Aug 04 14:01:02.052703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 392/758] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:01 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:02.321916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b5bc0917-f8f8-4190-8efd-b01aefb86547 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 38194 microversion: 2.1 time: 0.396174 Aug 04 14:01:02.323032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 367/759] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:01:01 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 38194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:01:02.639536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-69b9410d-531f-43a4-8002-2a7ebf444a31 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:02.640086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-69b9410d-531f-43a4-8002-2a7ebf444a31 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:02.646489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-69b9410d-531f-43a4-8002-2a7ebf444a31 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:02.646937 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-69b9410d-531f-43a4-8002-2a7ebf444a31 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:02.647750 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-69b9410d-531f-43a4-8002-2a7ebf444a31 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:02.648176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-69b9410d-531f-43a4-8002-2a7ebf444a31 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:02.782090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-69b9410d-531f-43a4-8002-2a7ebf444a31 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:02.790092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-69b9410d-531f-43a4-8002-2a7ebf444a31 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.154868 Aug 04 14:01:02.790677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 393/760] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:02 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:02.880490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-19465d5f-38cf-4864-84c6-6ec8947e6e14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:02.881495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-19465d5f-38cf-4864-84c6-6ec8947e6e14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:02.884299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0d7dbd21-bb13-413f-94c4-4308e1a90a48 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:02.884904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0d7dbd21-bb13-413f-94c4-4308e1a90a48 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:02.888909 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-19465d5f-38cf-4864-84c6-6ec8947e6e14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:02.889360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-19465d5f-38cf-4864-84c6-6ec8947e6e14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:02.890279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-19465d5f-38cf-4864-84c6-6ec8947e6e14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:02.890684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-19465d5f-38cf-4864-84c6-6ec8947e6e14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:02.891867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0d7dbd21-bb13-413f-94c4-4308e1a90a48 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:02.892477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0d7dbd21-bb13-413f-94c4-4308e1a90a48 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:02.893376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0d7dbd21-bb13-413f-94c4-4308e1a90a48 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:02.893808 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0d7dbd21-bb13-413f-94c4-4308e1a90a48 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:03.029498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0d7dbd21-bb13-413f-94c4-4308e1a90a48 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:03.036971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0d7dbd21-bb13-413f-94c4-4308e1a90a48 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1514 microversion: 2.1 time: 0.156623 Aug 04 14:01:03.037553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 394/761] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:02 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:03.070901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fcdaad3e-7bab-4987-92ad-685ae863239b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:03.071506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fcdaad3e-7bab-4987-92ad-685ae863239b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:03.078492 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcdaad3e-7bab-4987-92ad-685ae863239b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:03.078942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcdaad3e-7bab-4987-92ad-685ae863239b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:03.079730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcdaad3e-7bab-4987-92ad-685ae863239b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:03.080159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fcdaad3e-7bab-4987-92ad-685ae863239b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:03.166702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-19465d5f-38cf-4864-84c6-6ec8947e6e14 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 38371 microversion: 2.20 time: 0.290217 Aug 04 14:01:03.167527 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 368/762] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:01:02 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 38371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:01:03.220633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fcdaad3e-7bab-4987-92ad-685ae863239b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:03.227955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fcdaad3e-7bab-4987-92ad-685ae863239b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.160697 Aug 04 14:01:03.228676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 395/763] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:03 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:03.344013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-70ec8771-41af-4f8c-b495-81c0c5a37a85 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:03.346012 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-70ec8771-41af-4f8c-b495-81c0c5a37a85 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:03.352546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70ec8771-41af-4f8c-b495-81c0c5a37a85 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:03.352986 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70ec8771-41af-4f8c-b495-81c0c5a37a85 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:03.353770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70ec8771-41af-4f8c-b495-81c0c5a37a85 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:03.354229 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-70ec8771-41af-4f8c-b495-81c0c5a37a85 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:03.509667 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-70ec8771-41af-4f8c-b495-81c0c5a37a85 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 38194 microversion: 2.1 time: 0.176443 Aug 04 14:01:03.511527 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 369/764] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:01:03 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 38194 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:01:03.808472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-29b53be3-6f20-4dca-94f5-5247d4091ee4 req-3bb66f53-efaa-4578-806a-2d264dbc47c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dc1422-f4fa-4416-9b79-15b3c7007585", "name": "network-vif-deleted", "tag": "0fc8291a-e253-4038-bcac-04eafda43f22"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:03.813507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-78a5c68b-31c5-4b58-bb74-0faf424d2689 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:03.814892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-78a5c68b-31c5-4b58-bb74-0faf424d2689 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:03.819023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:03.819023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:01:03.821094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-78a5c68b-31c5-4b58-bb74-0faf424d2689 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:03.821550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-78a5c68b-31c5-4b58-bb74-0faf424d2689 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:03.822622 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-78a5c68b-31c5-4b58-bb74-0faf424d2689 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:03.823327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-78a5c68b-31c5-4b58-bb74-0faf424d2689 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:03.827588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-29b53be3-6f20-4dca-94f5-5247d4091ee4 req-3bb66f53-efaa-4578-806a-2d264dbc47c1 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:03.828172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-29b53be3-6f20-4dca-94f5-5247d4091ee4 req-3bb66f53-efaa-4578-806a-2d264dbc47c1 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:03.848451 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-29b53be3-6f20-4dca-94f5-5247d4091ee4 req-3bb66f53-efaa-4578-806a-2d264dbc47c1 service nova] Creating event network-vif-deleted:0fc8291a-e253-4038-bcac-04eafda43f22 for instance 08dc1422-f4fa-4416-9b79-15b3c7007585 on hv-cinder-79264 Aug 04 14:01:03.854797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-29b53be3-6f20-4dca-94f5-5247d4091ee4 req-3bb66f53-efaa-4578-806a-2d264dbc47c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050565 Aug 04 14:01:03.856545 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 370/765] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:03.983420 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-78a5c68b-31c5-4b58-bb74-0faf424d2689 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:03.991703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-78a5c68b-31c5-4b58-bb74-0faf424d2689 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.181801 Aug 04 14:01:03.992612 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 396/766] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:03 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:04.054064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:04.054762 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:04.064162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.064639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.065512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.066073 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.102539 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.102981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.103436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lazy-loading 'fault' on Instance uuid 08dc1422-f4fa-4416-9b79-15b3c7007585 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:01:04.158094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:04.161238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d89b23a8-fb24-4af7-8927-68268711b411 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 200 len: 1308 microversion: 2.1 time: 0.111412 Aug 04 14:01:04.161832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 371/767] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:04 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:04.180835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8ac970e7-bcea-4565-aae8-46b4cfdc1586 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:04.182165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8ac970e7-bcea-4565-aae8-46b4cfdc1586 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:04.189269 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ac970e7-bcea-4565-aae8-46b4cfdc1586 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.189703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ac970e7-bcea-4565-aae8-46b4cfdc1586 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.190474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ac970e7-bcea-4565-aae8-46b4cfdc1586 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.190900 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ac970e7-bcea-4565-aae8-46b4cfdc1586 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.245624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a3f1797f-af0a-45d5-8214-34d7e788f644 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:04.246323 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a3f1797f-af0a-45d5-8214-34d7e788f644 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:04.252814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a3f1797f-af0a-45d5-8214-34d7e788f644 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.253254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a3f1797f-af0a-45d5-8214-34d7e788f644 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.262006 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a3f1797f-af0a-45d5-8214-34d7e788f644 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.262006 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a3f1797f-af0a-45d5-8214-34d7e788f644 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.354567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8ac970e7-bcea-4565-aae8-46b4cfdc1586 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 200 len: 38514 microversion: 2.20 time: 0.178678 Aug 04 14:01:04.355232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 397/768] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:01:04 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 38514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:04.366412 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-185b477a-3373-4aa1-9cb7-00523f876d9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:04.367165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-185b477a-3373-4aa1-9cb7-00523f876d9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:04.374860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-185b477a-3373-4aa1-9cb7-00523f876d9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.375446 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-185b477a-3373-4aa1-9cb7-00523f876d9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.376516 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-185b477a-3373-4aa1-9cb7-00523f876d9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.377065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-185b477a-3373-4aa1-9cb7-00523f876d9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.399966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a3f1797f-af0a-45d5-8214-34d7e788f644 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:04.407700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a3f1797f-af0a-45d5-8214-34d7e788f644 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.165854 Aug 04 14:01:04.408354 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-185b477a-3373-4aa1-9cb7-00523f876d9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/ips" status: 200 len: 151 microversion: 2.20 time: 0.046170 Aug 04 14:01:04.408558 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 372/769] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:04 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:04.413507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 398/770] 10.222.0.43 () {60 vars in 1289 bytes} [Wed Aug 4 14:01:04 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:01:04.525807 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c87e8488-44d7-4481-9926-ee1141b19ab7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:04.526631 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c87e8488-44d7-4481-9926-ee1141b19ab7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:04.533838 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c87e8488-44d7-4481-9926-ee1141b19ab7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.534327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c87e8488-44d7-4481-9926-ee1141b19ab7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.535130 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c87e8488-44d7-4481-9926-ee1141b19ab7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.535596 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c87e8488-44d7-4481-9926-ee1141b19ab7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.821029 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c87e8488-44d7-4481-9926-ee1141b19ab7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 200 len: 38325 microversion: 2.1 time: 0.298809 Aug 04 14:01:04.821851 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 373/771] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:01:04 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 38325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:01:04.838512 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5bc2349a-de86-4ac6-b7ca-85d3dca677c3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:04.838512 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5bc2349a-de86-4ac6-b7ca-85d3dca677c3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:04.845488 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5bc2349a-de86-4ac6-b7ca-85d3dca677c3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.846042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5bc2349a-de86-4ac6-b7ca-85d3dca677c3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.847471 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5bc2349a-de86-4ac6-b7ca-85d3dca677c3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:04.848330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5bc2349a-de86-4ac6-b7ca-85d3dca677c3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:04.889131 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5bc2349a-de86-4ac6-b7ca-85d3dca677c3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/ips" status: 200 len: 147 microversion: 2.1 time: 0.057599 Aug 04 14:01:04.889719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 399/772] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Aug 4 14:01:04 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/ips => generated 147 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:01:05.014908 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4bd34ff0-0fed-4dd4-87e9-2235bf32cf76 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:05.015822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4bd34ff0-0fed-4dd4-87e9-2235bf32cf76 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:05.023468 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bd34ff0-0fed-4dd4-87e9-2235bf32cf76 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:05.023917 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bd34ff0-0fed-4dd4-87e9-2235bf32cf76 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:05.024725 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bd34ff0-0fed-4dd4-87e9-2235bf32cf76 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:05.025162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bd34ff0-0fed-4dd4-87e9-2235bf32cf76 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:05.185733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:05.186397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 08dc1422-f4fa-4416-9b79-15b3c7007585] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:05.192381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:05.192829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:05.193614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:05.194044 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:05.209243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] HTTP exception thrown: Instance 08dc1422-f4fa-4416-9b79-15b3c7007585 could not be found. Aug 04 14:01:05.209971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Returning 404 to user: Instance 08dc1422-f4fa-4416-9b79-15b3c7007585 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:05.210971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-421e844c-6de5-4de6-9f96-b446521b074e tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585" status: 404 len: 111 microversion: 2.1 time: 0.029920 Aug 04 14:01:05.211394 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4bd34ff0-0fed-4dd4-87e9-2235bf32cf76 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce48ac6eb6434638a63ff06cc22c18e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0454d3b2b844899064bc25b77f5fb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:05.220488 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 400/773] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:05 2021] GET /compute/v2.1/servers/08dc1422-f4fa-4416-9b79-15b3c7007585 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:01:05.231577 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4bd34ff0-0fed-4dd4-87e9-2235bf32cf76 tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 200 len: 1521 microversion: 2.1 time: 0.223787 Aug 04 14:01:05.232762 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 374/774] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:05 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:05.424352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4f84c049-afca-4438-a8f9-41276b0d07d7 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:05.424862 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4f84c049-afca-4438-a8f9-41276b0d07d7 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:05.431331 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f84c049-afca-4438-a8f9-41276b0d07d7 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:05.431766 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f84c049-afca-4438-a8f9-41276b0d07d7 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:05.433556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f84c049-afca-4438-a8f9-41276b0d07d7 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:05.434122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f84c049-afca-4438-a8f9-41276b0d07d7 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:05.567399 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4f84c049-afca-4438-a8f9-41276b0d07d7 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:05.575064 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4f84c049-afca-4438-a8f9-41276b0d07d7 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.154495 Aug 04 14:01:05.575627 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 401/775] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:05 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:05.873086 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-1af8656a-87d9-4413-b3eb-3531afb19eb9 req-41508cde-ccf9-4b6d-8bc3-35d3e7cdf1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee769da-062a-4fe8-bd70-3dce1f031665", "name": "network-vif-deleted", "tag": "cca51760-a38b-4efa-be59-cfcd9a84171a"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:05.875109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:05.875109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:01:05.885884 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-1af8656a-87d9-4413-b3eb-3531afb19eb9 req-41508cde-ccf9-4b6d-8bc3-35d3e7cdf1fe service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:05.886453 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-1af8656a-87d9-4413-b3eb-3531afb19eb9 req-41508cde-ccf9-4b6d-8bc3-35d3e7cdf1fe service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:05.900458 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-1af8656a-87d9-4413-b3eb-3531afb19eb9 req-41508cde-ccf9-4b6d-8bc3-35d3e7cdf1fe service nova] Creating event network-vif-deleted:cca51760-a38b-4efa-be59-cfcd9a84171a for instance 7ee769da-062a-4fe8-bd70-3dce1f031665 on hv-cinder-79264 Aug 04 14:01:05.907892 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-1af8656a-87d9-4413-b3eb-3531afb19eb9 req-41508cde-ccf9-4b6d-8bc3-35d3e7cdf1fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038858 Aug 04 14:01:05.908907 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 375/776] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:06.252831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:06.253619 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] [instance: 7ee769da-062a-4fe8-bd70-3dce1f031665] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:06.261779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.262797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.264245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.264906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.281103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] HTTP exception thrown: Instance 7ee769da-062a-4fe8-bd70-3dce1f031665 could not be found. Aug 04 14:01:06.281705 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] Returning 404 to user: Instance 7ee769da-062a-4fe8-bd70-3dce1f031665 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:06.282714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-19aeb8c6-77b2-4690-be24-70c4860e8d4a tempest-ServerRescueNegativeTestJSON-2072571591 tempest-ServerRescueNegativeTestJSON-2072571591-project] 10.222.0.43 "GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665" status: 404 len: 111 microversion: 2.1 time: 0.033614 Aug 04 14:01:06.283425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 402/777] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:06 2021] GET /compute/v2.1/servers/7ee769da-062a-4fe8-bd70-3dce1f031665 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:06.394182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-74ab16b4-2530-4297-8337-6796b9cb36dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:06.394836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-74ab16b4-2530-4297-8337-6796b9cb36dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:06.405888 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74ab16b4-2530-4297-8337-6796b9cb36dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.406858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74ab16b4-2530-4297-8337-6796b9cb36dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.408256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74ab16b4-2530-4297-8337-6796b9cb36dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.409244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74ab16b4-2530-4297-8337-6796b9cb36dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.479178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-74ab16b4-2530-4297-8337-6796b9cb36dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:01:06.588951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-74ab16b4-2530-4297-8337-6796b9cb36dc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 204 len: 0 microversion: 2.1 time: 0.204179 Aug 04 14:01:06.590054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 376/778] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:01:06 2021] DELETE /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:01:06.593606 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7f0e6b51-1b86-4026-80d5-b920b636099c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:06.595264 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7f0e6b51-1b86-4026-80d5-b920b636099c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:06.601826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-323198ae-f2a7-42a8-9830-1999f8135ab0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:06.602683 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-323198ae-f2a7-42a8-9830-1999f8135ab0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:06.606865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f0e6b51-1b86-4026-80d5-b920b636099c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.609988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-323198ae-f2a7-42a8-9830-1999f8135ab0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.610718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-323198ae-f2a7-42a8-9830-1999f8135ab0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.611321 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f0e6b51-1b86-4026-80d5-b920b636099c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.611858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-323198ae-f2a7-42a8-9830-1999f8135ab0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.612494 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-323198ae-f2a7-42a8-9830-1999f8135ab0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.614506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f0e6b51-1b86-4026-80d5-b920b636099c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.615417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f0e6b51-1b86-4026-80d5-b920b636099c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.661040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-323198ae-f2a7-42a8-9830-1999f8135ab0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lazy-loading 'flavor' on Instance uuid b5a6e241-9234-4ca1-b4ca-7b90733ab705 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:01:06.811258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7f0e6b51-1b86-4026-80d5-b920b636099c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:06.819387 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7f0e6b51-1b86-4026-80d5-b920b636099c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.230481 Aug 04 14:01:06.828501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 403/779] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:06 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:06.828501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-28d64a0f-3572-4e4d-9323-0d3c9a11a9ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:06.828810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-28d64a0f-3572-4e4d-9323-0d3c9a11a9ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:06.839457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28d64a0f-3572-4e4d-9323-0d3c9a11a9ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.840467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28d64a0f-3572-4e4d-9323-0d3c9a11a9ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.841328 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28d64a0f-3572-4e4d-9323-0d3c9a11a9ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.841762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28d64a0f-3572-4e4d-9323-0d3c9a11a9ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.967923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-323198ae-f2a7-42a8-9830-1999f8135ab0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 202 len: 0 microversion: 2.20 time: 0.371768 Aug 04 14:01:06.969508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 377/780] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:01:06 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:01:06.981550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:06.982722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:06.990690 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.991489 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.992686 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:06.993359 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:06.999628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-28d64a0f-3572-4e4d-9323-0d3c9a11a9ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:07.007898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-28d64a0f-3572-4e4d-9323-0d3c9a11a9ed tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1515 microversion: 2.1 time: 0.186430 Aug 04 14:01:07.009411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 404/781] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:06 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:07.247539 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:07.255624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:07.257150 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:07.258385 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8c295441-9b5b-4e60-ad74-c97c6ccc0252 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.283903 Aug 04 14:01:07.258871 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 378/782] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:06 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:07.728933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a5098688-0b86-450a-92b0-4f9c19b68abb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1210f66a-f880-4569-a887-3182772e47f6"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:07.730031 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a5098688-0b86-450a-92b0-4f9c19b68abb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:07.737052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a5098688-0b86-450a-92b0-4f9c19b68abb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:07.737496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a5098688-0b86-450a-92b0-4f9c19b68abb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:07.739031 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a5098688-0b86-450a-92b0-4f9c19b68abb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:07.739467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a5098688-0b86-450a-92b0-4f9c19b68abb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:07.837315 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d897c344-a49d-4da2-93d8-64a22a570a8d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:07.837927 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d897c344-a49d-4da2-93d8-64a22a570a8d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:07.844021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d897c344-a49d-4da2-93d8-64a22a570a8d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:07.844500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d897c344-a49d-4da2-93d8-64a22a570a8d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:07.845274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d897c344-a49d-4da2-93d8-64a22a570a8d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:07.845728 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d897c344-a49d-4da2-93d8-64a22a570a8d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:08.072724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a5098688-0b86-450a-92b0-4f9c19b68abb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346737 Aug 04 14:01:08.073342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 405/783] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 14:01:07 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:08.081794 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1c844480-2866-4186-ac4b-9ca99e62aef4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:08.082498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1c844480-2866-4186-ac4b-9ca99e62aef4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:08.093090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c844480-2866-4186-ac4b-9ca99e62aef4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:08.093860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c844480-2866-4186-ac4b-9ca99e62aef4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:08.095206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c844480-2866-4186-ac4b-9ca99e62aef4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:08.096735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c844480-2866-4186-ac4b-9ca99e62aef4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:08.307810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1c844480-2866-4186-ac4b-9ca99e62aef4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:08.318851 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1c844480-2866-4186-ac4b-9ca99e62aef4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1515 microversion: 2.1 time: 0.244110 Aug 04 14:01:08.332259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 406/784] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:08 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:08.332259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:08.332259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:08.341762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:08.342476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:08.343624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:08.344395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:08.407799 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d897c344-a49d-4da2-93d8-64a22a570a8d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:08.416182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d897c344-a49d-4da2-93d8-64a22a570a8d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.582434 Aug 04 14:01:08.417257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 379/785] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:07 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:08.504818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:08.513740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:08.515328 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:08.516555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-00114220-836e-4bd3-9e02-6e0431dab9bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.194738 Aug 04 14:01:08.517591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 407/786] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:08 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:09.349499 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7633e047-dff9-4161-8c1a-dd52da156017 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:09.350583 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7633e047-dff9-4161-8c1a-dd52da156017 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:09.358488 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7633e047-dff9-4161-8c1a-dd52da156017 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:09.359167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7633e047-dff9-4161-8c1a-dd52da156017 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:09.360034 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7633e047-dff9-4161-8c1a-dd52da156017 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:09.360747 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7633e047-dff9-4161-8c1a-dd52da156017 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:09.440579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fd9aa2a3-c862-4c88-91bd-092659bef3d9 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:09.441677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fd9aa2a3-c862-4c88-91bd-092659bef3d9 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:09.448987 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fd9aa2a3-c862-4c88-91bd-092659bef3d9 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:09.449196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fd9aa2a3-c862-4c88-91bd-092659bef3d9 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:09.449881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fd9aa2a3-c862-4c88-91bd-092659bef3d9 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:09.450313 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fd9aa2a3-c862-4c88-91bd-092659bef3d9 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:09.653978 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7633e047-dff9-4161-8c1a-dd52da156017 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:09.663559 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7633e047-dff9-4161-8c1a-dd52da156017 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1515 microversion: 2.1 time: 0.319718 Aug 04 14:01:09.664634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 380/787] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:09 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1515 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:09.670795 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:09.672100 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:09.680044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:09.684926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:09.685793 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:09.687516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:09.709839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fd9aa2a3-c862-4c88-91bd-092659bef3d9 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:09.721636 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fd9aa2a3-c862-4c88-91bd-092659bef3d9 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.288771 Aug 04 14:01:09.735964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 408/788] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:09 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:09.954771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:09.963700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:09.965425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:09.966711 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a2a78c1b-8a2f-409e-94a8-3448f8b7d67c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.300602 Aug 04 14:01:09.967402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 381/789] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:09 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:10.164354 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-3c357f08-7519-47a0-a906-1d718d208ab2 req-21689ffa-f9fd-414c-bf8b-f6ab4a8447fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b58917f-f9cf-44fc-9710-66a328803d79", "name": "network-vif-deleted", "tag": "83f9b0c4-dded-4107-9f3a-6d8a68ac1f41"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:10.166284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:10.166284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:01:10.175604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-3c357f08-7519-47a0-a906-1d718d208ab2 req-21689ffa-f9fd-414c-bf8b-f6ab4a8447fb service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:10.176074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-3c357f08-7519-47a0-a906-1d718d208ab2 req-21689ffa-f9fd-414c-bf8b-f6ab4a8447fb service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:10.189821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-3c357f08-7519-47a0-a906-1d718d208ab2 req-21689ffa-f9fd-414c-bf8b-f6ab4a8447fb service nova] Creating event network-vif-deleted:83f9b0c4-dded-4107-9f3a-6d8a68ac1f41 for instance 6b58917f-f9cf-44fc-9710-66a328803d79 on hv-cinder-79264 Aug 04 14:01:10.196545 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-3c357f08-7519-47a0-a906-1d718d208ab2 req-21689ffa-f9fd-414c-bf8b-f6ab4a8447fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035669 Aug 04 14:01:10.198005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 409/790] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:10.680676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:10.681944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:10.690754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:10.691475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:10.692809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:10.693411 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:10.737767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-e494a629-4b04-4bc8-8f2e-be3798d362ce req-e5aa0e2a-4e95-4de7-9767-adef79dc556d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2690b010-926e-4e5e-ae24-f0e14a968d86", "name": "network-vif-plugged", "status": "completed", "tag": "e58a7a3a-6a1b-406f-bc99-b15c2b8d7059"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:10.741716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:10.741716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:01:10.744844 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:10.746632 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:10.747052 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lazy-loading 'fault' on Instance uuid 6b58917f-f9cf-44fc-9710-66a328803d79 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:01:10.757475 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-e494a629-4b04-4bc8-8f2e-be3798d362ce req-e5aa0e2a-4e95-4de7-9767-adef79dc556d service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:10.758228 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-e494a629-4b04-4bc8-8f2e-be3798d362ce req-e5aa0e2a-4e95-4de7-9767-adef79dc556d service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:10.779101 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-e494a629-4b04-4bc8-8f2e-be3798d362ce req-e5aa0e2a-4e95-4de7-9767-adef79dc556d service nova] Creating event network-vif-plugged:e58a7a3a-6a1b-406f-bc99-b15c2b8d7059 for instance 2690b010-926e-4e5e-ae24-f0e14a968d86 on hv-cinder-79264 Aug 04 14:01:10.787958 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-e494a629-4b04-4bc8-8f2e-be3798d362ce req-e5aa0e2a-4e95-4de7-9767-adef79dc556d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055328 Aug 04 14:01:10.789327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 410/791] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:01:10.799290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-aed1aca2-de9e-4594-ba55-90085b70ee84 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:10.800901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-aed1aca2-de9e-4594-ba55-90085b70ee84 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:10.811845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aed1aca2-de9e-4594-ba55-90085b70ee84 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:10.812487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aed1aca2-de9e-4594-ba55-90085b70ee84 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:10.813625 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aed1aca2-de9e-4594-ba55-90085b70ee84 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:10.814214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aed1aca2-de9e-4594-ba55-90085b70ee84 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:10.814813 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:10.832735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a5a7daa8-fb0e-485b-b8ad-7eb12abf30d5 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 200 len: 1308 microversion: 2.1 time: 0.154456 Aug 04 14:01:10.833993 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 382/792] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:10 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:10.988932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:10.989827 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:10.998145 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:10.999057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:11.005111 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-aed1aca2-de9e-4594-ba55-90085b70ee84 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:11.007455 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:11.010966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:11.015256 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-aed1aca2-de9e-4594-ba55-90085b70ee84 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.223654 Aug 04 14:01:11.016612 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 411/793] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:10 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:11.226608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:11.235401 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:11.236998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:11.238175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5ee28cdf-a74e-4228-95fb-8b68eeb12796 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.254797 Aug 04 14:01:11.238752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 383/794] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:10 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:11.728349 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-05f2b949-3eea-483c-8b26-abcecd829e19 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] Action: 'create', calling method: .version_select at 0x7efe81223430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-996545927", "metadata": {"Type": "work"}}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:11.850727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:11.851567 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 6b58917f-f9cf-44fc-9710-66a328803d79] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:11.858331 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:11.858854 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:11.859755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:11.860357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:11.875902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] HTTP exception thrown: Instance 6b58917f-f9cf-44fc-9710-66a328803d79 could not be found. Aug 04 14:01:11.876557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Returning 404 to user: Instance 6b58917f-f9cf-44fc-9710-66a328803d79 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:11.877505 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f511e926-be58-4e43-aaed-4e677581abb3 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79" status: 404 len: 111 microversion: 2.1 time: 0.030375 Aug 04 14:01:11.878316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 384/795] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:11 2021] GET /compute/v2.1/servers/6b58917f-f9cf-44fc-9710-66a328803d79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:01:11.889565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c69c6115-bd5d-4402-a770-26a79dc745e4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:11.890129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c69c6115-bd5d-4402-a770-26a79dc745e4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:11.897595 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c69c6115-bd5d-4402-a770-26a79dc745e4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:11.898114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c69c6115-bd5d-4402-a770-26a79dc745e4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:11.898966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c69c6115-bd5d-4402-a770-26a79dc745e4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:11.899393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c69c6115-bd5d-4402-a770-26a79dc745e4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:11.926929 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c69c6115-bd5d-4402-a770-26a79dc745e4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:01:12.016265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c69c6115-bd5d-4402-a770-26a79dc745e4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 204 len: 0 microversion: 2.1 time: 0.132285 Aug 04 14:01:12.020357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 385/796] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:01:11 2021] DELETE /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:12.028675 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-76679514-dbb6-49dc-acb1-40787acfdcbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:12.029458 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-76679514-dbb6-49dc-acb1-40787acfdcbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:12.036549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-76679514-dbb6-49dc-acb1-40787acfdcbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:12.037089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-76679514-dbb6-49dc-acb1-40787acfdcbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:12.037945 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-76679514-dbb6-49dc-acb1-40787acfdcbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:12.038499 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-76679514-dbb6-49dc-acb1-40787acfdcbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:12.056370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-05f2b949-3eea-483c-8b26-abcecd829e19 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.463707 Aug 04 14:01:12.057002 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 412/797] 10.222.0.43 () {60 vars in 1156 bytes} [Wed Aug 4 14:01:11 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 04 14:01:12.067705 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-66288f54-20e7-4b39-a6b7-39c851d74cdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:12.068581 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-66288f54-20e7-4b39-a6b7-39c851d74cdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:12.075397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66288f54-20e7-4b39-a6b7-39c851d74cdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:12.075847 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66288f54-20e7-4b39-a6b7-39c851d74cdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:12.076740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66288f54-20e7-4b39-a6b7-39c851d74cdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:12.077189 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66288f54-20e7-4b39-a6b7-39c851d74cdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:12.179605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-76679514-dbb6-49dc-acb1-40787acfdcbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:12.186942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-76679514-dbb6-49dc-acb1-40787acfdcbc tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1513 microversion: 2.1 time: 0.165296 Aug 04 14:01:12.187525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 386/798] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:12 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:12.191820 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-dfa4ad2b-a495-4430-a42a-adc058aca63f tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] Calling method '.version_select at 0x7efe7c45bdc0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:12.208552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-66288f54-20e7-4b39-a6b7-39c851d74cdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:12.217896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-66288f54-20e7-4b39-a6b7-39c851d74cdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.153704 Aug 04 14:01:12.218469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 413/799] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:12 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:12.246543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-dfa4ad2b-a495-4430-a42a-adc058aca63f tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe" status: 200 len: 352 microversion: 2.1 time: 0.057696 Aug 04 14:01:12.247113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 387/800] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:01:12 2021] GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:12.257275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:12.257871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:12.264764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:12.265208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:12.265992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:12.266416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:12.418236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:12.427158 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:12.428693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:12.429849 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-520bf066-c526-40ab-a2e7-b93252eddfb8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.176483 Aug 04 14:01:12.430424 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 414/801] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:12 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:13.208716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-15e9e437-c864-456b-9daf-f0213362e56a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.209781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-15e9e437-c864-456b-9daf-f0213362e56a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:13.217915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15e9e437-c864-456b-9daf-f0213362e56a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:13.218409 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15e9e437-c864-456b-9daf-f0213362e56a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:13.219302 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15e9e437-c864-456b-9daf-f0213362e56a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:13.219747 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-15e9e437-c864-456b-9daf-f0213362e56a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:13.235305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3e94808d-6830-4d9b-9d13-0cd17cf6df7b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.235985 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3e94808d-6830-4d9b-9d13-0cd17cf6df7b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:13.242349 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3e94808d-6830-4d9b-9d13-0cd17cf6df7b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:13.243143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3e94808d-6830-4d9b-9d13-0cd17cf6df7b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:13.244473 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3e94808d-6830-4d9b-9d13-0cd17cf6df7b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:13.245162 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3e94808d-6830-4d9b-9d13-0cd17cf6df7b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:13.366733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-15e9e437-c864-456b-9daf-f0213362e56a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:13.377216 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-15e9e437-c864-456b-9daf-f0213362e56a tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1513 microversion: 2.1 time: 0.176103 Aug 04 14:01:13.377828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 388/802] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:13 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:13.382583 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-55e9ce14-2cc3-4ea4-a40b-c050b1e7aa7e tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] Calling method '.version_select at 0x7efe7c464670>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.450601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-55e9ce14-2cc3-4ea4-a40b-c050b1e7aa7e tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe" status: 200 len: 353 microversion: 2.1 time: 0.071693 Aug 04 14:01:13.451297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 389/803] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:01:13 2021] GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:13.451999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3e94808d-6830-4d9b-9d13-0cd17cf6df7b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:13.456954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.457586 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:13.463964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:13.464920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:13.465730 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:13.466171 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:13.466417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3e94808d-6830-4d9b-9d13-0cd17cf6df7b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1318 microversion: 2.1 time: 0.234654 Aug 04 14:01:13.467086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 415/804] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:13 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:13.472007 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-eaa847c5-c737-4f3f-ac49-68d3f4824487 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] Calling method '.version_select at 0x7efe7c45a1f0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.529895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-eaa847c5-c737-4f3f-ac49-68d3f4824487 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe" status: 200 len: 353 microversion: 2.1 time: 0.061165 Aug 04 14:01:13.530496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 416/805] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:01:13 2021] GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:13.556964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-809bb3c7-1754-4683-9d3b-5c89a0749bb2 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] Calling method '.version_select at 0x7efe81223e50>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.612048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:13.626471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:13.629552 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:13.631774 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8213e0df-0f48-4a50-95a8-6a89774ad7e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.178343 Aug 04 14:01:13.633015 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 390/806] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:13 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:13.647600 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-809bb3c7-1754-4683-9d3b-5c89a0749bb2 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe" status: 202 len: 0 microversion: 2.1 time: 0.094472 Aug 04 14:01:13.648174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 417/807] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Aug 4 14:01:13 2021] DELETE /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:01:13.656692 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-899e37ef-4eae-4bac-bf5d-83f29285a7c7 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] Calling method '.version_select at 0x7efe7c47c8b0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.721762 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-899e37ef-4eae-4bac-bf5d-83f29285a7c7 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe" status: 200 len: 352 microversion: 2.1 time: 0.068846 Aug 04 14:01:13.722357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 391/808] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:01:13 2021] GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:01:14.400984 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4b44d237-7b7a-4164-92bc-150179bfd78f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:14.401593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4b44d237-7b7a-4164-92bc-150179bfd78f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:14.408877 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4b44d237-7b7a-4164-92bc-150179bfd78f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:14.409322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4b44d237-7b7a-4164-92bc-150179bfd78f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:14.410090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4b44d237-7b7a-4164-92bc-150179bfd78f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:14.410519 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4b44d237-7b7a-4164-92bc-150179bfd78f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:14.487566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c65d4437-6c6c-4da6-9149-f4633c1be228 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:14.488152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c65d4437-6c6c-4da6-9149-f4633c1be228 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:14.494064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c65d4437-6c6c-4da6-9149-f4633c1be228 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:14.494502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c65d4437-6c6c-4da6-9149-f4633c1be228 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:14.495430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c65d4437-6c6c-4da6-9149-f4633c1be228 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:14.497192 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c65d4437-6c6c-4da6-9149-f4633c1be228 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:14.534599 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4b44d237-7b7a-4164-92bc-150179bfd78f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:14.542097 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4b44d237-7b7a-4164-92bc-150179bfd78f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1513 microversion: 2.1 time: 0.144730 Aug 04 14:01:14.543333 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 418/809] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:14 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:14.641952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c65d4437-6c6c-4da6-9149-f4633c1be228 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:14.649702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c65d4437-6c6c-4da6-9149-f4633c1be228 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1507 microversion: 2.1 time: 0.166331 Aug 04 14:01:14.650303 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 392/810] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:14 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:14.665868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:14.666474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:14.673196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:14.673644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:14.674498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:14.674867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:14.735589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-424c0b17-612d-4109-bfdd-7c24b0082ad8 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] Calling method '.version_select at 0x7efe7c641ca0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:14.766462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-424c0b17-612d-4109-bfdd-7c24b0082ad8 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] HTTP exception thrown: Volume 42f53e08-c7aa-4daa-85de-e1d292a8ccbe could not be found. Aug 04 14:01:14.767063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-424c0b17-612d-4109-bfdd-7c24b0082ad8 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] Returning 404 to user: Volume 42f53e08-c7aa-4daa-85de-e1d292a8ccbe could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:14.767895 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-424c0b17-612d-4109-bfdd-7c24b0082ad8 tempest-VolumesGetTestJSON-1712260773 tempest-VolumesGetTestJSON-1712260773-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe" status: 404 len: 109 microversion: 2.1 time: 0.036613 Aug 04 14:01:14.768822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 393/811] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:01:14 2021] GET /compute/v2.1/os-volumes/42f53e08-c7aa-4daa-85de-e1d292a8ccbe => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:01:14.827499 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:14.836646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:14.839244 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:14.841952 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-624c4225-b06f-4d91-a69f-e866e83de910 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.179456 Aug 04 14:01:14.847551 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 419/812] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:14 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:15.501944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-db4ac8bb-6ebb-426a-86cf-05d3dad75d56 req-64e92e65-8c0c-45e1-b98c-a76d9d1d13a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2", "name": "network-vif-deleted", "tag": "609e30bc-41d6-4f52-9b43-6b4c4b3d1df3"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:15.504393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:15.504393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:01:15.516388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-db4ac8bb-6ebb-426a-86cf-05d3dad75d56 req-64e92e65-8c0c-45e1-b98c-a76d9d1d13a8 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:15.517177 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-db4ac8bb-6ebb-426a-86cf-05d3dad75d56 req-64e92e65-8c0c-45e1-b98c-a76d9d1d13a8 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:15.543789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-db4ac8bb-6ebb-426a-86cf-05d3dad75d56 req-64e92e65-8c0c-45e1-b98c-a76d9d1d13a8 service nova] Creating event network-vif-deleted:609e30bc-41d6-4f52-9b43-6b4c4b3d1df3 for instance a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 on hv-cinder-79264 Aug 04 14:01:15.555080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-db4ac8bb-6ebb-426a-86cf-05d3dad75d56 req-64e92e65-8c0c-45e1-b98c-a76d9d1d13a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057451 Aug 04 14:01:15.556083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 394/813] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:15.565041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8ee07929-6e3e-4939-883d-2c8ba62cfe6b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:15.565819 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8ee07929-6e3e-4939-883d-2c8ba62cfe6b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:15.571839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ee07929-6e3e-4939-883d-2c8ba62cfe6b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:15.572872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ee07929-6e3e-4939-883d-2c8ba62cfe6b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:15.574452 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ee07929-6e3e-4939-883d-2c8ba62cfe6b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:15.575099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8ee07929-6e3e-4939-883d-2c8ba62cfe6b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:15.683883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8ee07929-6e3e-4939-883d-2c8ba62cfe6b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:15.704012 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8ee07929-6e3e-4939-883d-2c8ba62cfe6b tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 200 len: 1302 microversion: 2.1 time: 0.142724 Aug 04 14:01:15.706786 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 420/814] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:15 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 1302 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:15.755579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5aac7173-f346-4b66-adae-dcb3b34991ad tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:15.767265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5aac7173-f346-4b66-adae-dcb3b34991ad tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:15.768407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5aac7173-f346-4b66-adae-dcb3b34991ad tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:15.850276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5aac7173-f346-4b66-adae-dcb3b34991ad tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Going to try to stop instance {{(pid=107823) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 04 14:01:15.871615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:15.872401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:15.878168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:15.878628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:15.879384 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:15.879811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:15.898189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5aac7173-f346-4b66-adae-dcb3b34991ad tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.146468 Aug 04 14:01:15.899034 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 395/815] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:01:15 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:15.907234 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0176044e-b71d-4204-b705-48e7e5f04698 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:15.907947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0176044e-b71d-4204-b705-48e7e5f04698 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:15.920130 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0176044e-b71d-4204-b705-48e7e5f04698 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:15.921165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0176044e-b71d-4204-b705-48e7e5f04698 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:15.922147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0176044e-b71d-4204-b705-48e7e5f04698 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:15.928713 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0176044e-b71d-4204-b705-48e7e5f04698 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:16.033092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:16.041938 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:16.044416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:16.045713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a40583fa-b69a-4c52-98ab-0f755d47b16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.178450 Aug 04 14:01:16.046561 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 421/816] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:15 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:16.068696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0176044e-b71d-4204-b705-48e7e5f04698 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:16.081061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0176044e-b71d-4204-b705-48e7e5f04698 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.177684 Aug 04 14:01:16.081832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 396/817] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:15 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:16.722897 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:16.723749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:16.730797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:16.731793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:16.732669 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:16.733276 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:16.747019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] HTTP exception thrown: Instance a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 could not be found. Aug 04 14:01:16.747806 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Returning 404 to user: Instance a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:16.748821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ef0fd641-5e16-4f3f-b0b5-b607a38f01da tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2" status: 404 len: 111 microversion: 2.1 time: 0.029726 Aug 04 14:01:16.749367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 422/818] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:16 2021] GET /compute/v2.1/servers/a8ed2f1e-3b18-40a6-9f44-b536eea9dcc2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:17.064721 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:17.065256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:17.071008 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:17.071448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:17.072236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:17.072926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:17.101407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5d2cd4db-678c-4ba3-b4d4-1106fa8333e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:17.102405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5d2cd4db-678c-4ba3-b4d4-1106fa8333e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:17.109615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5d2cd4db-678c-4ba3-b4d4-1106fa8333e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:17.110253 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5d2cd4db-678c-4ba3-b4d4-1106fa8333e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:17.111069 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5d2cd4db-678c-4ba3-b4d4-1106fa8333e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:17.111533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5d2cd4db-678c-4ba3-b4d4-1106fa8333e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:17.215441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:17.225015 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:17.226768 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:17.227945 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4ad79a91-7392-47b3-a362-b6bc770c65e6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.166994 Aug 04 14:01:17.238356 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 397/819] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:17 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:17.258861 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5d2cd4db-678c-4ba3-b4d4-1106fa8333e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:17.268828 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5d2cd4db-678c-4ba3-b4d4-1106fa8333e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.173779 Aug 04 14:01:17.269477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 423/820] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:17 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:17.904393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-25542b1c-91b1-4b37-883b-099c6b2ecc44 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:17.904886 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-25542b1c-91b1-4b37-883b-099c6b2ecc44 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:17.910723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25542b1c-91b1-4b37-883b-099c6b2ecc44 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:17.911168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25542b1c-91b1-4b37-883b-099c6b2ecc44 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:17.911935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25542b1c-91b1-4b37-883b-099c6b2ecc44 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:17.912488 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25542b1c-91b1-4b37-883b-099c6b2ecc44 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:17.937703 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-25542b1c-91b1-4b37-883b-099c6b2ecc44 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:01:18.018382 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-25542b1c-91b1-4b37-883b-099c6b2ecc44 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 204 len: 0 microversion: 2.1 time: 0.118095 Aug 04 14:01:18.019114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 398/821] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:01:17 2021] DELETE /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:18.028145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-19d1a77d-8b4d-4494-9689-4d33e740f7f4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:18.028781 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-19d1a77d-8b4d-4494-9689-4d33e740f7f4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:18.034821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19d1a77d-8b4d-4494-9689-4d33e740f7f4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:18.035270 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19d1a77d-8b4d-4494-9689-4d33e740f7f4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:18.036152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19d1a77d-8b4d-4494-9689-4d33e740f7f4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:18.036685 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19d1a77d-8b4d-4494-9689-4d33e740f7f4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:18.163181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-19d1a77d-8b4d-4494-9689-4d33e740f7f4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:18.171520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-19d1a77d-8b4d-4494-9689-4d33e740f7f4 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1513 microversion: 2.1 time: 0.147755 Aug 04 14:01:18.172069 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 424/822] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:18 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:18.249305 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:18.250160 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:18.259326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:18.259776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:18.260601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:18.261542 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:18.286244 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c916a9d4-2023-41e4-9ff6-516bba9b6fa2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:18.286858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c916a9d4-2023-41e4-9ff6-516bba9b6fa2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:18.292850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c916a9d4-2023-41e4-9ff6-516bba9b6fa2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:18.293279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c916a9d4-2023-41e4-9ff6-516bba9b6fa2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:18.310700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c916a9d4-2023-41e4-9ff6-516bba9b6fa2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:18.311171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c916a9d4-2023-41e4-9ff6-516bba9b6fa2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:18.407051 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:18.421111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:18.422610 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:18.423683 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2b3cc0a1-b4ef-4690-b923-14501eadd00f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.178965 Aug 04 14:01:18.424371 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 399/823] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:18 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:18.473826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c916a9d4-2023-41e4-9ff6-516bba9b6fa2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:18.482727 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c916a9d4-2023-41e4-9ff6-516bba9b6fa2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.200054 Aug 04 14:01:18.483317 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 425/824] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:18 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:19.189156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9cbc572b-791a-4b6b-a2f1-54cea5ccbe04 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:19.189763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9cbc572b-791a-4b6b-a2f1-54cea5ccbe04 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:19.195638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9cbc572b-791a-4b6b-a2f1-54cea5ccbe04 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:19.196085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9cbc572b-791a-4b6b-a2f1-54cea5ccbe04 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:19.196887 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9cbc572b-791a-4b6b-a2f1-54cea5ccbe04 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:19.197575 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9cbc572b-791a-4b6b-a2f1-54cea5ccbe04 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:19.320300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9cbc572b-791a-4b6b-a2f1-54cea5ccbe04 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:19.327809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9cbc572b-791a-4b6b-a2f1-54cea5ccbe04 tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1513 microversion: 2.1 time: 0.142558 Aug 04 14:01:19.328544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 400/825] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:19 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:19.442827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:19.443429 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:19.450979 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:19.451451 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:19.452284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:19.452715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:19.502693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4a8c60c2-6e1b-45ee-aa5a-f04e399781b8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:19.503357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4a8c60c2-6e1b-45ee-aa5a-f04e399781b8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:19.510965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a8c60c2-6e1b-45ee-aa5a-f04e399781b8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:19.511397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a8c60c2-6e1b-45ee-aa5a-f04e399781b8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:19.512431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a8c60c2-6e1b-45ee-aa5a-f04e399781b8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:19.512855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a8c60c2-6e1b-45ee-aa5a-f04e399781b8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:19.584809 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:19.593559 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:19.595060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:19.596359 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b1fc7ae2-f6ae-4ed1-8f46-9388b6282844 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.157710 Aug 04 14:01:19.596964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 426/826] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:19 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:19.652744 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4a8c60c2-6e1b-45ee-aa5a-f04e399781b8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:19.666339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4a8c60c2-6e1b-45ee-aa5a-f04e399781b8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.171298 Aug 04 14:01:19.666933 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 401/827] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:19 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:20.345676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-45dfc9cc-672e-4e71-8307-ee499ce66f3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:20.346328 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-45dfc9cc-672e-4e71-8307-ee499ce66f3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:20.352139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-45dfc9cc-672e-4e71-8307-ee499ce66f3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:20.352629 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-45dfc9cc-672e-4e71-8307-ee499ce66f3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:20.353395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-45dfc9cc-672e-4e71-8307-ee499ce66f3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:20.353830 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-45dfc9cc-672e-4e71-8307-ee499ce66f3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:20.518892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-45dfc9cc-672e-4e71-8307-ee499ce66f3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:20.526493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-45dfc9cc-672e-4e71-8307-ee499ce66f3f tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1513 microversion: 2.1 time: 0.185094 Aug 04 14:01:20.527718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 427/828] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:20 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:20.614695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:20.615324 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:20.621159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:20.621647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:20.622448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:20.622872 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:20.686963 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e13399a3-841e-4775-99aa-3e50208deff8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:20.687581 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e13399a3-841e-4775-99aa-3e50208deff8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:20.693769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e13399a3-841e-4775-99aa-3e50208deff8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:20.694210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e13399a3-841e-4775-99aa-3e50208deff8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:20.695005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e13399a3-841e-4775-99aa-3e50208deff8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:20.695433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e13399a3-841e-4775-99aa-3e50208deff8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:20.845968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:20.860049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e13399a3-841e-4775-99aa-3e50208deff8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:20.861265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:20.862865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:20.864064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5c184506-e7fb-46da-9a1f-28496db2d0d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.253092 Aug 04 14:01:20.864677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 402/829] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:20 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:20.871836 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e13399a3-841e-4775-99aa-3e50208deff8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.188494 Aug 04 14:01:20.873129 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 428/830] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:20 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:21.299437 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-4f06d184-1390-4422-908c-d0ba0fe708db req-804a7819-4b52-4e0f-862e-42123b5b3bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393f6f8-d997-4def-9ada-9df175d346be", "name": "network-vif-deleted", "tag": "7e794fec-4d42-4e16-a581-d3659230bffe"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:21.302248 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:21.302248 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:01:21.311025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-4f06d184-1390-4422-908c-d0ba0fe708db req-804a7819-4b52-4e0f-862e-42123b5b3bd8 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:21.311546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-4f06d184-1390-4422-908c-d0ba0fe708db req-804a7819-4b52-4e0f-862e-42123b5b3bd8 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:21.325146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-4f06d184-1390-4422-908c-d0ba0fe708db req-804a7819-4b52-4e0f-862e-42123b5b3bd8 service nova] Creating event network-vif-deleted:7e794fec-4d42-4e16-a581-d3659230bffe for instance 5393f6f8-d997-4def-9ada-9df175d346be on hv-cinder-79264 Aug 04 14:01:21.331260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-4f06d184-1390-4422-908c-d0ba0fe708db req-804a7819-4b52-4e0f-862e-42123b5b3bd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038415 Aug 04 14:01:21.331875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 403/831] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:01:21.546122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.546785 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:21.552774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:21.553414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:21.554813 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:21.555969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:21.596323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:21.596909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:21.597368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lazy-loading 'fault' on Instance uuid 5393f6f8-d997-4def-9ada-9df175d346be {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:01:21.642084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19e6144804c449586614d68ec2abe7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c2c98b135f4239ab56572ec4a259e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:21.650312 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b41b400c-57f6-4ee5-a30d-6587310babac tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 200 len: 1307 microversion: 2.1 time: 0.109933 Aug 04 14:01:21.651221 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 429/832] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:21 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:21.883328 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.884140 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:21.889906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2fca1f73-dd98-4c48-bb68-fee0c76d8239 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.890556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2fca1f73-dd98-4c48-bb68-fee0c76d8239 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:21.890832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:21.891253 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:21.892072 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:21.892527 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:21.897327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2fca1f73-dd98-4c48-bb68-fee0c76d8239 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:21.897620 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2fca1f73-dd98-4c48-bb68-fee0c76d8239 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:21.898861 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2fca1f73-dd98-4c48-bb68-fee0c76d8239 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:21.899628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2fca1f73-dd98-4c48-bb68-fee0c76d8239 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:22.055205 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:22.063751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:22.065346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:22.066694 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-89f861ec-c094-4611-b722-a0a0d4e2f56b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.187549 Aug 04 14:01:22.067301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 404/833] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:21 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:22.103897 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2fca1f73-dd98-4c48-bb68-fee0c76d8239 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:22.113020 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2fca1f73-dd98-4c48-bb68-fee0c76d8239 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.227284 Aug 04 14:01:22.113927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 430/834] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:21 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:22.668612 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:22.669313 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] [instance: 5393f6f8-d997-4def-9ada-9df175d346be] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:22.675207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:22.675734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:22.676544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:22.676979 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:22.690014 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] HTTP exception thrown: Instance 5393f6f8-d997-4def-9ada-9df175d346be could not be found. Aug 04 14:01:22.690604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] Returning 404 to user: Instance 5393f6f8-d997-4def-9ada-9df175d346be could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:22.691465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-11c50ec9-89a6-43e9-ac4c-49caf7367b6d tempest-AttachVolumeNegativeTest-1541706822 tempest-AttachVolumeNegativeTest-1541706822-project] 10.222.0.43 "GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be" status: 404 len: 111 microversion: 2.1 time: 0.027398 Aug 04 14:01:22.692013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 405/835] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:22 2021] GET /compute/v2.1/servers/5393f6f8-d997-4def-9ada-9df175d346be => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:23.086033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:23.087199 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:23.093864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:23.094307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:23.095139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:23.095508 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:23.133819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0d3a2c0b-a1ae-4e65-a3b2-b8e65988cfed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:23.150609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0d3a2c0b-a1ae-4e65-a3b2-b8e65988cfed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:23.160793 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0d3a2c0b-a1ae-4e65-a3b2-b8e65988cfed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:23.161248 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0d3a2c0b-a1ae-4e65-a3b2-b8e65988cfed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:23.162046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0d3a2c0b-a1ae-4e65-a3b2-b8e65988cfed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:23.162601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0d3a2c0b-a1ae-4e65-a3b2-b8e65988cfed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:23.325184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0d3a2c0b-a1ae-4e65-a3b2-b8e65988cfed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:23.339853 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0d3a2c0b-a1ae-4e65-a3b2-b8e65988cfed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.211576 Aug 04 14:01:23.340985 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 406/836] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:23 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:23.342643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:23.353202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:23.356454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:23.357662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0a568e44-af0d-4065-ae10-c901a2dd2903 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.275497 Aug 04 14:01:23.358235 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 431/837] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:23 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:24.359662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-578acb6d-0eb9-46c0-aea1-c9a027681ec8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.361075 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-578acb6d-0eb9-46c0-aea1-c9a027681ec8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:24.369016 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-578acb6d-0eb9-46c0-aea1-c9a027681ec8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:24.369016 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-578acb6d-0eb9-46c0-aea1-c9a027681ec8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:24.369742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-578acb6d-0eb9-46c0-aea1-c9a027681ec8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:24.370201 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-578acb6d-0eb9-46c0-aea1-c9a027681ec8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:24.384194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.385373 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:24.392923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:24.393361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:24.394507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:24.395134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:24.604482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:24.618417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:24.621079 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:24.622422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-07319258-6cc0-440e-98b6-dd89557a7d93 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1743 microversion: 2.20 time: 0.244948 Aug 04 14:01:24.623122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 432/838] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:24 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1743 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:24.627512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-578acb6d-0eb9-46c0-aea1-c9a027681ec8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:24.635301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-578acb6d-0eb9-46c0-aea1-c9a027681ec8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.279721 Aug 04 14:01:24.638611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 407/839] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:24 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:24.809703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-19beb460-8626-4156-aca3-4088b16af912 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Action: 'create', calling method: .version_select at 0x7efe7c4b0790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-575848361", "metadata": {"Type": "work"}}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:24.811450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-19beb460-8626-4156-aca3-4088b16af912 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:24.812468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-19beb460-8626-4156-aca3-4088b16af912 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143036 Aug 04 14:01:24.817770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 433/840] 10.222.0.43 () {60 vars in 1156 bytes} [Wed Aug 4 14:01:24 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:01:24.823997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-42c2ae95-0861-4ba9-9a34-1dceead31cb3 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Action: 'create', calling method: .version_select at 0x7efe7c3dbb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-202580528", "metadata": {"Type": "work"}}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:24.827115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-42c2ae95-0861-4ba9-9a34-1dceead31cb3 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:24.829298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-42c2ae95-0861-4ba9-9a34-1dceead31cb3 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010174 Aug 04 14:01:24.843613 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 408/841] 10.222.0.43 () {60 vars in 1156 bytes} [Wed Aug 4 14:01:24 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:01:24.848642 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dfed972a-3c57-473a-a25f-7505abf84b7c tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Action: 'create', calling method: .version_select at 0x7efe7c45a790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1866856133", "metadata": {"Type": "work"}}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:24.849824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dfed972a-3c57-473a-a25f-7505abf84b7c tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:24.850663 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-dfed972a-3c57-473a-a25f-7505abf84b7c tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007461 Aug 04 14:01:24.851205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 434/842] 10.222.0.43 () {60 vars in 1156 bytes} [Wed Aug 4 14:01:24 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:01:24.865592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7d757ecf-4a35-4733-a1d4-a7f7816e87d1 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Calling method '.version_select at 0x7efe7c56c700>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.913936 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-7d757ecf-4a35-4733-a1d4-a7f7816e87d1 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] HTTP exception thrown: Volume tempest-invalid-1227889763 could not be found. Aug 04 14:01:24.914539 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7d757ecf-4a35-4733-a1d4-a7f7816e87d1 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Returning 404 to user: Volume tempest-invalid-1227889763 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:24.915385 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7d757ecf-4a35-4733-a1d4-a7f7816e87d1 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1227889763" status: 404 len: 99 microversion: 2.1 time: 0.057854 Aug 04 14:01:24.915943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 409/843] 10.222.0.43 () {58 vars in 1218 bytes} [Wed Aug 4 14:01:24 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1227889763 => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:01:24.927947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-361404b1-62fa-45e4-a11c-dbbb6bc855ff tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005837 Aug 04 14:01:24.928993 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 435/844] 10.222.0.43 () {58 vars in 1140 bytes} [Wed Aug 4 14:01:24 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 14:01:24.940160 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3dca656f-eae7-4078-9e9b-7b4365cae24b tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004276 Aug 04 14:01:24.940766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 410/845] 10.222.0.43 () {58 vars in 1137 bytes} [Wed Aug 4 14:01:24 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 14:01:24.950642 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-99d0ba21-3cb1-414e-b73c-35c530d01f88 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Calling method '.version_select at 0x7efe7c4cba60>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.977986 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-99d0ba21-3cb1-414e-b73c-35c530d01f88 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] HTTP exception thrown: Volume 74900a5d-fc1b-4155-b7cc-3652deebfcbc could not be found. Aug 04 14:01:24.978592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-99d0ba21-3cb1-414e-b73c-35c530d01f88 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Returning 404 to user: Volume 74900a5d-fc1b-4155-b7cc-3652deebfcbc could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:24.980259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-99d0ba21-3cb1-414e-b73c-35c530d01f88 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/74900a5d-fc1b-4155-b7cc-3652deebfcbc" status: 404 len: 109 microversion: 2.1 time: 0.033706 Aug 04 14:01:24.981337 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 436/846] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Aug 4 14:01:24 2021] DELETE /compute/v2.1/os-volumes/74900a5d-fc1b-4155-b7cc-3652deebfcbc => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:01:24.990959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-02b67996-563b-4b45-9232-1d2a7b2faa02 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Calling method '.version_select at 0x7efe7d838280>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:25.024269 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-02b67996-563b-4b45-9232-1d2a7b2faa02 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] HTTP exception thrown: Volume 14e111e9-4012-4640-aaee-c8f02f63143c could not be found. Aug 04 14:01:25.024870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-02b67996-563b-4b45-9232-1d2a7b2faa02 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] Returning 404 to user: Volume 14e111e9-4012-4640-aaee-c8f02f63143c could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:01:25.025763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-02b67996-563b-4b45-9232-1d2a7b2faa02 tempest-VolumesNegativeTest-1901323679 tempest-VolumesNegativeTest-1901323679-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/14e111e9-4012-4640-aaee-c8f02f63143c" status: 404 len: 109 microversion: 2.1 time: 0.038966 Aug 04 14:01:25.026312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 411/847] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:01:24 2021] GET /compute/v2.1/os-volumes/14e111e9-4012-4640-aaee-c8f02f63143c => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:25.641840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:25.642507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:25.657843 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-59e5185f-0840-40cf-94f1-d563c84fa376 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:25.658752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-59e5185f-0840-40cf-94f1-d563c84fa376 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:25.666478 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:25.666954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:25.668205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:25.668679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:25.668817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59e5185f-0840-40cf-94f1-d563c84fa376 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:25.669155 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59e5185f-0840-40cf-94f1-d563c84fa376 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:25.670038 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59e5185f-0840-40cf-94f1-d563c84fa376 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:25.670397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-59e5185f-0840-40cf-94f1-d563c84fa376 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:25.825866 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:25.844106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:25.845865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:25.847142 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0ed3e5ec-62f0-4b69-a64b-a6f98823ce90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1743 microversion: 2.20 time: 0.209169 Aug 04 14:01:25.847828 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 437/848] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:25 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1743 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:25.859753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-59e5185f-0840-40cf-94f1-d563c84fa376 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:25.872181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-59e5185f-0840-40cf-94f1-d563c84fa376 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.222161 Aug 04 14:01:25.872913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 412/849] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:25 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:26.430054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-75b01c53-13f3-4617-b9bc-2d0c3c7bb402 req-4e80fedd-11af-4469-9a5f-f2b0f52564ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a6e241-9234-4ca1-b4ca-7b90733ab705", "name": "network-vif-plugged", "status": "completed", "tag": "828cc1c2-4556-4cd2-a0e7-2ed9383548e4"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:26.437274 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:26.437274 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:01:26.478743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-75b01c53-13f3-4617-b9bc-2d0c3c7bb402 req-4e80fedd-11af-4469-9a5f-f2b0f52564ee service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:26.480819 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-75b01c53-13f3-4617-b9bc-2d0c3c7bb402 req-4e80fedd-11af-4469-9a5f-f2b0f52564ee service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:26.515308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-75b01c53-13f3-4617-b9bc-2d0c3c7bb402 req-4e80fedd-11af-4469-9a5f-f2b0f52564ee service nova] Creating event network-vif-plugged:828cc1c2-4556-4cd2-a0e7-2ed9383548e4 for instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 on hv-cinder-79264 Aug 04 14:01:26.521160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-75b01c53-13f3-4617-b9bc-2d0c3c7bb402 req-4e80fedd-11af-4469-9a5f-f2b0f52564ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097053 Aug 04 14:01:26.522285 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 438/850] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:26.880096 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:26.881590 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:26.889013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:26.889733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:26.890968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:26.891591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:26.891965 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-66eda4a5-d723-4cb5-8d5a-4c2043186276 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:26.892950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-66eda4a5-d723-4cb5-8d5a-4c2043186276 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:26.906815 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66eda4a5-d723-4cb5-8d5a-4c2043186276 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:26.907764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66eda4a5-d723-4cb5-8d5a-4c2043186276 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:26.908825 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66eda4a5-d723-4cb5-8d5a-4c2043186276 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:26.910887 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66eda4a5-d723-4cb5-8d5a-4c2043186276 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:27.082714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:27.092585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:27.094487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:27.095881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-43e136e7-d92d-46ec-8f9f-56e20d6e20e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1743 microversion: 2.20 time: 0.222872 Aug 04 14:01:27.096578 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 413/851] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:26 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:27.132538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-66eda4a5-d723-4cb5-8d5a-4c2043186276 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:27.148277 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-66eda4a5-d723-4cb5-8d5a-4c2043186276 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.261054 Aug 04 14:01:27.149358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 439/852] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:26 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:28.117626 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:28.118248 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:28.127959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:28.128679 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:28.129548 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:28.130008 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:28.180352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-51648fe5-97d0-4b6d-97cb-f977b81f125d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:28.181587 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-51648fe5-97d0-4b6d-97cb-f977b81f125d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:28.202815 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-51648fe5-97d0-4b6d-97cb-f977b81f125d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:28.210058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-51648fe5-97d0-4b6d-97cb-f977b81f125d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:28.210948 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-51648fe5-97d0-4b6d-97cb-f977b81f125d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:28.211401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-51648fe5-97d0-4b6d-97cb-f977b81f125d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:28.442624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:28.457653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:28.461373 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:28.464666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-da90dc94-9cf0-4878-af79-c1b805ef29fb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1743 microversion: 2.20 time: 0.350303 Aug 04 14:01:28.468493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-51648fe5-97d0-4b6d-97cb-f977b81f125d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:28.474920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 414/853] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:28 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1743 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:28.489019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-51648fe5-97d0-4b6d-97cb-f977b81f125d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.315092 Aug 04 14:01:28.490475 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 440/854] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:28 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:29.499359 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:29.501641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:29.512521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:29.513610 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:29.514803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b61e8460-9f2e-4ef4-b617-3faf33d55322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:29.516177 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:29.516634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b61e8460-9f2e-4ef4-b617-3faf33d55322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:29.518431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:29.528415 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b61e8460-9f2e-4ef4-b617-3faf33d55322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:29.530051 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b61e8460-9f2e-4ef4-b617-3faf33d55322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:29.531591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b61e8460-9f2e-4ef4-b617-3faf33d55322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:29.532571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b61e8460-9f2e-4ef4-b617-3faf33d55322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:29.695786 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:29.721515 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:29.723511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:29.724831 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-745e2fec-7868-477b-9245-3ed690143f1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1743 microversion: 2.20 time: 0.233225 Aug 04 14:01:29.728267 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 415/855] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:29 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1743 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:29.802839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b61e8460-9f2e-4ef4-b617-3faf33d55322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:29.817484 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b61e8460-9f2e-4ef4-b617-3faf33d55322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.310535 Aug 04 14:01:29.819687 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 441/856] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:29 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:30.753126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:30.755045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:30.767267 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:30.768279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:30.769608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:30.770324 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:30.843598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e76b3bdd-1e8b-4152-8cc4-87292b6c8495 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:30.848850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e76b3bdd-1e8b-4152-8cc4-87292b6c8495 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:30.860914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e76b3bdd-1e8b-4152-8cc4-87292b6c8495 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:30.861808 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e76b3bdd-1e8b-4152-8cc4-87292b6c8495 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:30.862943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e76b3bdd-1e8b-4152-8cc4-87292b6c8495 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:30.863851 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e76b3bdd-1e8b-4152-8cc4-87292b6c8495 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:31.075939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:31.105788 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:31.107455 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:31.109360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b6061720-f904-402c-9a51-643a3caa599f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1743 microversion: 2.20 time: 0.364868 Aug 04 14:01:31.110313 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 416/857] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:30 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1743 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:31.183992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e76b3bdd-1e8b-4152-8cc4-87292b6c8495 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:31.194140 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e76b3bdd-1e8b-4152-8cc4-87292b6c8495 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.358515 Aug 04 14:01:31.195431 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 442/858] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:30 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:32.149798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:32.149798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:32.149798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:32.149798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:32.150524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:32.150524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:32.217623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ac25f812-5864-44d8-b026-3a787273ac70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:32.218250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ac25f812-5864-44d8-b026-3a787273ac70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:32.228416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ac25f812-5864-44d8-b026-3a787273ac70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:32.229262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ac25f812-5864-44d8-b026-3a787273ac70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:32.230976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ac25f812-5864-44d8-b026-3a787273ac70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:32.231692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ac25f812-5864-44d8-b026-3a787273ac70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:32.368761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:32.383965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:32.385795 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:32.387398 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1a673193-180a-4d9c-a2bf-594c9cf5ed07 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.252667 Aug 04 14:01:32.388193 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 417/859] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:32 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:32.522006 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ac25f812-5864-44d8-b026-3a787273ac70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:32.544717 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ac25f812-5864-44d8-b026-3a787273ac70 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.331073 Aug 04 14:01:32.546242 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 443/860] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:32 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:33.415553 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:33.417059 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:33.428650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:33.429105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:33.435396 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:33.435834 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:33.583779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7b45d511-cbd0-4d33-9351-6966191db2ea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:33.586634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7b45d511-cbd0-4d33-9351-6966191db2ea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:33.598784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b45d511-cbd0-4d33-9351-6966191db2ea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:33.599940 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b45d511-cbd0-4d33-9351-6966191db2ea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:33.601571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b45d511-cbd0-4d33-9351-6966191db2ea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:33.602359 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7b45d511-cbd0-4d33-9351-6966191db2ea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:33.758364 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:33.770580 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:33.772239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:33.773483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-68b6bc67-560d-4a17-889f-e89684f799c4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.361748 Aug 04 14:01:33.774439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 418/861] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:33 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:34.333710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7b45d511-cbd0-4d33-9351-6966191db2ea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:34.355949 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7b45d511-cbd0-4d33-9351-6966191db2ea tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.787851 Aug 04 14:01:34.358798 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 444/862] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:33 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:34.815450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:34.824587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:34.851120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:34.854968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:34.857823 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:34.859446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:35.378722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-03363c6d-2757-4f9c-9c41-cc91c623d6a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:35.379704 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-03363c6d-2757-4f9c-9c41-cc91c623d6a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:35.391128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03363c6d-2757-4f9c-9c41-cc91c623d6a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:35.391597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03363c6d-2757-4f9c-9c41-cc91c623d6a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:35.394882 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03363c6d-2757-4f9c-9c41-cc91c623d6a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:35.395449 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03363c6d-2757-4f9c-9c41-cc91c623d6a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:35.684600 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-03363c6d-2757-4f9c-9c41-cc91c623d6a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:35.725121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-03363c6d-2757-4f9c-9c41-cc91c623d6a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.348491 Aug 04 14:01:35.735714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 445/863] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:35 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:35.889684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:35.917081 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:35.920384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:35.925741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-99700e48-c738-4ca5-b7f5-cd05a89aac03 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 1.121356 Aug 04 14:01:35.941450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 419/864] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:34 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:36.747741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e4438edb-5104-42d8-a588-45adf802a0ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:36.749677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e4438edb-5104-42d8-a588-45adf802a0ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:36.769595 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e4438edb-5104-42d8-a588-45adf802a0ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:36.770244 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e4438edb-5104-42d8-a588-45adf802a0ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:36.771193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e4438edb-5104-42d8-a588-45adf802a0ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:36.771773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e4438edb-5104-42d8-a588-45adf802a0ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:36.961504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:36.962356 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:36.972119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:36.972789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:36.977896 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:36.978652 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:36.979847 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e4438edb-5104-42d8-a588-45adf802a0ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:36.997545 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e4438edb-5104-42d8-a588-45adf802a0ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.256964 Aug 04 14:01:36.999966 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 446/865] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:36 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:37.175791 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:37.193170 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:37.197314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:37.200763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fc7f656c-a079-4514-a89d-28d551c436f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.242670 Aug 04 14:01:37.201708 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 420/866] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:36 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:37.742497 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:01:37.743159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:01:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:01:38.034394 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-19f6e57a-7af1-46a9-9395-4dd878ef82ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:38.035671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-19f6e57a-7af1-46a9-9395-4dd878ef82ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:38.048495 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19f6e57a-7af1-46a9-9395-4dd878ef82ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:38.049838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19f6e57a-7af1-46a9-9395-4dd878ef82ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:38.051483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19f6e57a-7af1-46a9-9395-4dd878ef82ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:38.052441 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-19f6e57a-7af1-46a9-9395-4dd878ef82ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:38.220762 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:38.221375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:38.234321 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:38.234799 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:38.236952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:38.238605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:38.298048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-19f6e57a-7af1-46a9-9395-4dd878ef82ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:38.308974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-19f6e57a-7af1-46a9-9395-4dd878ef82ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.283072 Aug 04 14:01:38.310308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 447/867] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:38 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:38.822854 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:38.836371 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:38.838525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:38.840628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1614f2de-7348-4a10-9c02-ee36e842aed2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.623767 Aug 04 14:01:38.842721 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 421/868] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:38 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:39.334434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-69faf2a8-7c8f-42be-b146-aec5db7f34eb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:39.336803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-69faf2a8-7c8f-42be-b146-aec5db7f34eb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:39.353160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-69faf2a8-7c8f-42be-b146-aec5db7f34eb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:39.355269 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-69faf2a8-7c8f-42be-b146-aec5db7f34eb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:39.357193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-69faf2a8-7c8f-42be-b146-aec5db7f34eb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:39.359020 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-69faf2a8-7c8f-42be-b146-aec5db7f34eb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:39.592688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-69faf2a8-7c8f-42be-b146-aec5db7f34eb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:39.605879 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-69faf2a8-7c8f-42be-b146-aec5db7f34eb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.282128 Aug 04 14:01:39.611711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 448/869] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:39 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:39.860902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:39.861683 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:39.871564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:39.872510 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:39.875283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:39.876365 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:40.142081 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:40.154372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:40.161220 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:40.162442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2e6df151-f9a8-42ff-bf5d-55fe114d95df tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.305474 Aug 04 14:01:40.163024 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 422/870] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:39 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:40.632744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-44bab824-10e1-4c3d-b2ba-866337dc2a22 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:40.633369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-44bab824-10e1-4c3d-b2ba-866337dc2a22 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:40.640566 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-44bab824-10e1-4c3d-b2ba-866337dc2a22 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:40.641018 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-44bab824-10e1-4c3d-b2ba-866337dc2a22 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:40.641814 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-44bab824-10e1-4c3d-b2ba-866337dc2a22 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:40.642259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-44bab824-10e1-4c3d-b2ba-866337dc2a22 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:40.813566 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-44bab824-10e1-4c3d-b2ba-866337dc2a22 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:40.823739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-44bab824-10e1-4c3d-b2ba-866337dc2a22 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1726 microversion: 2.1 time: 0.195121 Aug 04 14:01:40.824669 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 449/871] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:40 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:41.195800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:41.202985 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:41.209956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:41.210415 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:41.211232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:41.213011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:41.423166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:41.435757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:41.438366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:41.439663 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2e639a2e-fc00-4511-a305-0d4c4663d287 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.247849 Aug 04 14:01:41.440636 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 423/872] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:41 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:41.855392 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-90caa624-4896-48b9-b334-71f87202872c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:41.857963 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-90caa624-4896-48b9-b334-71f87202872c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:41.871436 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-90caa624-4896-48b9-b334-71f87202872c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:41.872926 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-90caa624-4896-48b9-b334-71f87202872c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:41.875771 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-90caa624-4896-48b9-b334-71f87202872c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:41.878250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-90caa624-4896-48b9-b334-71f87202872c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:42.152190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-90caa624-4896-48b9-b334-71f87202872c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:42.165093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-90caa624-4896-48b9-b334-71f87202872c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1703 microversion: 2.1 time: 0.321258 Aug 04 14:01:42.176885 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 450/873] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:41 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1703 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:42.193390 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2dffb107-ceaa-445d-8091-505b8db5308d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:42.204743 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2dffb107-ceaa-445d-8091-505b8db5308d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:42.206053 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2dffb107-ceaa-445d-8091-505b8db5308d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:42.242347 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2dffb107-ceaa-445d-8091-505b8db5308d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Going to try to start instance {{(pid=107823) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 04 14:01:42.313022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2dffb107-ceaa-445d-8091-505b8db5308d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.126893 Aug 04 14:01:42.326392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 424/874] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:01:42 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:42.328478 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-579aef3e-e46b-4d9d-a95e-4b27593e0b99 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:42.332756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-579aef3e-e46b-4d9d-a95e-4b27593e0b99 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:42.350447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-579aef3e-e46b-4d9d-a95e-4b27593e0b99 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:42.352130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-579aef3e-e46b-4d9d-a95e-4b27593e0b99 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:42.358509 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-579aef3e-e46b-4d9d-a95e-4b27593e0b99 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:42.359116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-579aef3e-e46b-4d9d-a95e-4b27593e0b99 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:42.460407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:42.461276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:42.470503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:42.474652 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:42.478000 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:42.480884 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:42.579042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-579aef3e-e46b-4d9d-a95e-4b27593e0b99 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:42.588662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-579aef3e-e46b-4d9d-a95e-4b27593e0b99 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1712 microversion: 2.1 time: 0.269825 Aug 04 14:01:42.589488 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 451/875] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:42 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1712 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:01:42.595388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-eadf4d31-214f-47f6-b551-a3be1b03e388 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "137881a1-221b-4fda-8bc2-49a883716985", "device": "/dev/sdb"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:42.597304 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-eadf4d31-214f-47f6-b551-a3be1b03e388 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:42.605774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eadf4d31-214f-47f6-b551-a3be1b03e388 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:42.606547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eadf4d31-214f-47f6-b551-a3be1b03e388 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:42.607875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eadf4d31-214f-47f6-b551-a3be1b03e388 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:42.608832 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eadf4d31-214f-47f6-b551-a3be1b03e388 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:42.867088 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:42.877825 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:42.882516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:42.888522 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6caffdd1-bb98-420a-9f71-10a4fac194e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.433166 Aug 04 14:01:42.889316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 425/876] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:42 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:43.082938 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-eadf4d31-214f-47f6-b551-a3be1b03e388 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "POST /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491895 Aug 04 14:01:43.090925 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 452/877] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 14:01:42 2021] POST /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86/os-volume_attachments => generated 194 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:43.612993 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-16195151-490b-4720-9825-f0bb9d5e241b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:43.616294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-16195151-490b-4720-9825-f0bb9d5e241b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:43.633002 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-16195151-490b-4720-9825-f0bb9d5e241b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:43.633977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-16195151-490b-4720-9825-f0bb9d5e241b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:43.637521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-16195151-490b-4720-9825-f0bb9d5e241b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:43.638975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-16195151-490b-4720-9825-f0bb9d5e241b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:43.844295 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-16195151-490b-4720-9825-f0bb9d5e241b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:43.854503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-16195151-490b-4720-9825-f0bb9d5e241b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1712 microversion: 2.1 time: 0.251179 Aug 04 14:01:43.855873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 426/878] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:43 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1712 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:43.912337 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:43.913326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:43.931094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:43.932002 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:43.934454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:43.935151 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:44.192662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:44.205168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:44.207325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:44.210556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e93bed4e-67c9-4ce2-ba21-dccf7dae29b7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.304922 Aug 04 14:01:44.225517 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 453/879] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:43 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:44.874295 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c53aab3b-79c5-456a-a791-2f7636769a45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:44.875236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c53aab3b-79c5-456a-a791-2f7636769a45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:44.886181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c53aab3b-79c5-456a-a791-2f7636769a45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:44.886641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c53aab3b-79c5-456a-a791-2f7636769a45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:44.887458 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c53aab3b-79c5-456a-a791-2f7636769a45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:44.888103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c53aab3b-79c5-456a-a791-2f7636769a45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:45.139567 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c53aab3b-79c5-456a-a791-2f7636769a45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:45.151936 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c53aab3b-79c5-456a-a791-2f7636769a45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1716 microversion: 2.1 time: 0.281061 Aug 04 14:01:45.153065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 427/880] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:01:44 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1716 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:45.231695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:45.232352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:45.242396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:45.243029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:45.249298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:45.250502 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:45.504059 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:45.512806 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:45.514623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:45.516141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7c2c02af-de93-4671-a346-14cbe7a21c15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.288402 Aug 04 14:01:45.517413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 454/881] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:45 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:46.534919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:46.535528 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:46.550252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:46.551372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:46.554078 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:46.554727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:46.818493 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:46.833286 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:46.835154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:46.836821 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c558cff2-ae6d-4ad2-b2c3-58d129692f3f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1738 microversion: 2.20 time: 0.305776 Aug 04 14:01:46.837622 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 428/882] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:46 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:47.866286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:47.867305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:47.874644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:47.875235 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:47.876341 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:47.877049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:48.053434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:48.077947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:48.082732 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:48.086557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-94838e54-df87-40f4-a6d3-81d3b6f9313e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1720 microversion: 2.20 time: 0.222834 Aug 04 14:01:48.089174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 455/883] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:47 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:49.119348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:49.120621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:49.127227 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:49.127673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:49.128506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:49.128934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:49.285174 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:49.298804 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:49.300380 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:49.301578 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e9f8a62d-64ea-4bcf-877d-9be35185435b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1720 microversion: 2.20 time: 0.186524 Aug 04 14:01:49.302159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 429/884] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:49 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:50.329020 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:50.330453 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:50.349284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:50.351688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:50.357103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:50.358812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:50.500678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-74745d46-b168-4fff-b5bf-7e3d9d9040a9 req-468639b5-7c54-4a5b-b727-95da1b10703b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a6e241-9234-4ca1-b4ca-7b90733ab705", "name": "network-vif-unplugged", "status": "completed", "tag": "828cc1c2-4556-4cd2-a0e7-2ed9383548e4"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:50.505183 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:50.505183 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:01:50.523057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-74745d46-b168-4fff-b5bf-7e3d9d9040a9 req-468639b5-7c54-4a5b-b727-95da1b10703b service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:50.524037 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-74745d46-b168-4fff-b5bf-7e3d9d9040a9 req-468639b5-7c54-4a5b-b727-95da1b10703b service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:50.549091 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-74745d46-b168-4fff-b5bf-7e3d9d9040a9 req-468639b5-7c54-4a5b-b727-95da1b10703b service nova] Creating event network-vif-unplugged:828cc1c2-4556-4cd2-a0e7-2ed9383548e4 for instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 on hv-cinder-79264 Aug 04 14:01:50.559942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-74745d46-b168-4fff-b5bf-7e3d9d9040a9 req-468639b5-7c54-4a5b-b727-95da1b10703b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065543 Aug 04 14:01:50.561771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 430/885] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:01:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:50.594967 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:50.607766 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:50.611113 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:50.612484 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-09c1b9f1-6980-43b5-8f92-b4def8ddc71d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1720 microversion: 2.20 time: 0.292243 Aug 04 14:01:50.613237 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 456/886] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:50 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1720 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:51.637918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:51.638700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:51.647512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:51.647512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:51.647512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:51.647808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:51.815055 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:51.828375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:51.829955 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:51.831178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a82ef561-619b-42e0-8adc-e5c1479cc781 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1663 microversion: 2.20 time: 0.198007 Aug 04 14:01:51.831758 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 431/887] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:51 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:51.871383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-85277e31-a2a2-4837-b264-fc5036ea6be9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83ad2464-a4bd-4319-a24b-f25a17173975"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:51.874521 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-85277e31-a2a2-4837-b264-fc5036ea6be9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:51.884783 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-85277e31-a2a2-4837-b264-fc5036ea6be9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:51.885554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-85277e31-a2a2-4837-b264-fc5036ea6be9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:51.886835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-85277e31-a2a2-4837-b264-fc5036ea6be9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:51.887312 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-85277e31-a2a2-4837-b264-fc5036ea6be9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:52.237963 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-85277e31-a2a2-4837-b264-fc5036ea6be9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.376196 Aug 04 14:01:52.239188 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 457/888] 10.222.0.43 () {62 vars in 1364 bytes} [Wed Aug 4 14:01:51 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/os-volume_attachments => generated 188 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:01:52.376206 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-218fdf6e-d150-455b-99b5-6126ef41cd0e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:52.377046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-218fdf6e-d150-455b-99b5-6126ef41cd0e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:52.386791 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-218fdf6e-d150-455b-99b5-6126ef41cd0e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:52.387422 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-218fdf6e-d150-455b-99b5-6126ef41cd0e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:52.388424 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-218fdf6e-d150-455b-99b5-6126ef41cd0e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:52.388961 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-218fdf6e-d150-455b-99b5-6126ef41cd0e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:52.495136 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-218fdf6e-d150-455b-99b5-6126ef41cd0e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action" status: 202 len: 0 microversion: 2.20 time: 0.122934 Aug 04 14:01:52.500651 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 432/889] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:01:52 2021] POST /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:52.506297 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:52.506935 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:52.514604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:52.515467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:52.516712 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:52.517407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:52.742858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:52.754971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:52.756577 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:52.758054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5eb41ead-526a-4760-a3f6-a98df564bcca tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1749 microversion: 2.20 time: 0.256082 Aug 04 14:01:52.758802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 458/890] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:52 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1749 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:53.779059 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:53.779853 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:53.790164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:53.790940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:53.793018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:53.793779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:53.944923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:53.954497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:53.956538 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:53.957716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8bb89975-8d03-4077-bee0-180087c487cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1749 microversion: 2.20 time: 0.183375 Aug 04 14:01:53.958294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 433/891] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:53 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:54.978171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:54.979436 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:54.991947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:54.992941 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:54.995045 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:54.996076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:55.143546 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:55.153608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:55.155110 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:55.156378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7336bdf6-2a40-4d53-9016-4ad78c72325a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1749 microversion: 2.20 time: 0.182954 Aug 04 14:01:55.156846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 459/892] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:54 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1749 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:56.179462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:56.180795 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:56.190772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:56.191571 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:56.193122 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:56.193724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:56.357753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:56.367640 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:56.369479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:56.370267 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c11c4375-b5d0-4654-bb40-31c11475d5a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.197914 Aug 04 14:01:56.370942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 434/893] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:56 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:57.539705 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:57.540336 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:57.546324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:57.546765 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:57.547549 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:57.547974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:57.696340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:57.708556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:57.710342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:57.711784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-da038223-f785-4eb8-9b99-1d548d8990b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.326086 Aug 04 14:01:57.712492 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 460/894] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:57 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:01:58.730974 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:58.731570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:58.737637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:58.738088 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:58.738865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:58.739298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:58.874401 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:58.883605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:58.885366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:58.887790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6fc1b3c5-287b-490b-b75e-5705ab4fb28a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.160641 Aug 04 14:01:58.888413 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 435/895] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:58 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:59.906570 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:59.907179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:01:59.913499 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:59.913950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:01:59.914727 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:01:59.915159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:00.046378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:00.055362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:00.056903 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:00.058567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5b3047f4-a5a8-4d81-8733-a7c1e10d1b1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.155458 Aug 04 14:02:00.059127 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 461/896] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:01:59 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:01.082235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:01.083369 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:01.094463 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:01.096030 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:01.096540 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:01.097341 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:01.237048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:01.245404 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:01.247506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:01.248700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ca448515-b4c8-4899-8c05-534e44c4fb6b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.173982 Aug 04 14:02:01.249263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 436/897] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:01 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:02.266893 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:02.267495 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:02.273768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:02.274211 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:02.275357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:02.275786 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:02.406044 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:02.416314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:02.417729 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:02.418869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0e7cfe8a-ab5d-412f-ad4f-50a09a74f5bd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.155781 Aug 04 14:02:02.419427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 462/898] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:02 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:03.438109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:03.438692 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:03.444801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:03.445247 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:03.446033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:03.446472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:03.574735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:03.583576 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:03.585111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:03.586263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d46d59f9-4861-4c72-b499-bac397903428 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.153023 Aug 04 14:02:03.586844 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 437/899] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:03 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:04.609530 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:04.610156 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:04.615913 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:04.616391 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:04.617177 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:04.617605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:04.752299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:04.760876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:04.763048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:04.764205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e563a05e-dddd-43f9-bbc8-38ef8292478e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.159235 Aug 04 14:02:04.764788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 463/900] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:04 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:05.782422 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:05.783022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:05.788966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:05.789405 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:05.790171 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:05.790597 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:05.918967 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:05.927304 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:05.928832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:05.929963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bd5c71ca-2e8e-4f5f-a81c-781efa97eb18 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.151309 Aug 04 14:02:05.930525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 438/901] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:05 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:06.949846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:06.950488 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:06.956396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:06.956843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:06.957617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:06.958047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:07.092325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:07.101058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:07.102688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:07.104365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a98988b4-e793-4dd9-999f-6738e94b553a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.158490 Aug 04 14:02:07.105437 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 464/902] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:06 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:08.123591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:08.124265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:08.129964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:08.130408 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:08.131175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:08.131622 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:08.259500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:08.269063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:08.270563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:08.271704 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-95dc371f-20b2-4a6d-84f6-b92e827aca91 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.152590 Aug 04 14:02:08.272291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 439/903] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:08 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:09.289731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:09.290321 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:09.296801 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:09.297250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:09.298025 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:09.298456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:09.431577 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:09.440874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:09.442363 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:09.443510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bc0492aa-8fe8-4860-bbe1-320c5902ee7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.157509 Aug 04 14:02:09.444080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 465/904] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:09 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:10.462877 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:10.463482 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:10.470530 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:10.470977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:10.471860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:10.472208 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:10.599179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:10.607808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:10.609333 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:10.610467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1a53eebe-8127-4d15-8b03-39a4ce833959 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.151439 Aug 04 14:02:10.611035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 440/905] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:10 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:11.627980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:11.628619 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:11.634404 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:11.634848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:11.635607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:11.636613 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:11.759271 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:11.768298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:11.769817 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:11.770955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cd59e28f-c781-4970-bb70-8cb29a722bea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.146657 Aug 04 14:02:11.771518 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 466/906] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:11 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:12.789231 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:12.789836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:12.795695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:12.796137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:12.796931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:12.797363 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:12.923829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:12.932194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:12.934291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:12.935423 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fc1fc945-dedf-4cdc-b113-0306a21f36db tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.149967 Aug 04 14:02:12.935988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 441/907] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:12 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:13.954545 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:13.955202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:13.961334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:13.961776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:13.962556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:13.963041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:14.087675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:14.096915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:14.098613 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:14.100046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6137387f-a83b-4e89-9cbd-4890f8b6d16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.149151 Aug 04 14:02:14.100680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 467/908] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:13 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:15.121636 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:15.122841 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:15.129528 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:15.130044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:15.130890 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:15.131388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:15.271780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:15.283098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:15.285516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:15.287554 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bdfed42b-b7d1-415a-9701-c415944d9ce3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1751 microversion: 2.20 time: 0.169363 Aug 04 14:02:15.288604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 442/909] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:15 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:16.310123 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:16.311240 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:16.321429 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:16.322105 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:16.324818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:16.325551 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:16.468583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:16.477381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:16.478932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:16.480300 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-801414a9-fa25-46b9-8990-f595f9e0ad79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.176959 Aug 04 14:02:16.480862 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 468/910] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:16 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:17.499654 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:17.500519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:17.507554 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:17.508015 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:17.508800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:17.509281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:17.696814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:17.705562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:17.707006 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:17.708160 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-74352870-aa30-4e14-8f56-0a1975929b26 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.212243 Aug 04 14:02:17.716419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 443/911] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:17 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:18.726099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:18.726842 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:18.736327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:18.736327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:18.736327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:18.736327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:18.747611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d1cd1d43-3b78-4413-99b4-ac6676e1aa11 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:18.749341 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d1cd1d43-3b78-4413-99b4-ac6676e1aa11 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:18.760242 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d1cd1d43-3b78-4413-99b4-ac6676e1aa11 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:18.761944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d1cd1d43-3b78-4413-99b4-ac6676e1aa11 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:18.763692 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d1cd1d43-3b78-4413-99b4-ac6676e1aa11 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:18.764801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d1cd1d43-3b78-4413-99b4-ac6676e1aa11 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:18.905336 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:18.913607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:18.916035 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:18.917800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-aadf3540-49cd-478f-9ca5-a4fbae529c9d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.195566 Aug 04 14:02:18.918375 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 469/912] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:18 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:18.959504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-d1cd1d43-3b78-4413-99b4-ac6676e1aa11 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lazy-loading 'services' on Instance uuid 2690b010-926e-4e5e-ae24-f0e14a968d86 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:02:19.102210 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d1cd1d43-3b78-4413-99b4-ac6676e1aa11 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86/os-volume_attachments/137881a1-221b-4fda-8bc2-49a883716985" status: 202 len: 0 microversion: 2.1 time: 0.362857 Aug 04 14:02:19.112372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 444/913] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:02:18 2021] DELETE /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86/os-volume_attachments/137881a1-221b-4fda-8bc2-49a883716985 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:02:19.935152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:19.935850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:19.942078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:19.942612 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:19.943679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:19.944175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:20.086469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:20.100980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:20.104170 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:20.106661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c87fab34-5803-4230-8b81-a2729288d4b3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.175116 Aug 04 14:02:20.120476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 470/914] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:19 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:21.129064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:21.129809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:21.136999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:21.137732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:21.138519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:21.138959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:21.280952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:21.289881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:21.291509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:21.293604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5ede1db0-497f-4e52-ba2b-f8033f3d2039 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.168716 Aug 04 14:02:21.294420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 445/915] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:21 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:22.312191 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:22.312951 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:22.319190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:22.319640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:22.320648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:22.321173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:22.452510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:22.461399 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:22.462961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:22.464843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5828a543-2331-4edc-8aea-c62a129d4644 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.156687 Aug 04 14:02:22.465407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 471/916] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:22 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:23.487519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:23.488059 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:23.494003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:23.494778 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:23.495866 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:23.496426 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:23.652367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:23.664436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:23.666543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:23.670428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e3624cc2-60c6-49b9-9657-81f5a9de7975 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.190274 Aug 04 14:02:23.691677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 446/917] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:23 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:24.704479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:24.705212 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:24.714434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:24.715166 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:24.716292 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:24.716774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:24.885245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.913508 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.916105 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.918848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-954cb997-5012-42a8-8d16-bfdbcee3bd3b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.219560 Aug 04 14:02:24.920323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 472/918] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:24 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:25.967407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:25.969033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:25.976056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:25.976774 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:25.977712 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:25.978318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:26.568093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:26.592635 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:26.596516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:26.597748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-955364cc-f4bd-49a1-a6d1-edc98a1ace63 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.657459 Aug 04 14:02:26.599568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 447/919] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:25 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:27.635276 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:27.636699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:27.642894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:27.643344 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:27.644654 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:27.645093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:27.814958 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.827084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.829322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.830818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a6bed230-2b6a-4c68-9e34-50bf7bea0d31 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.199361 Aug 04 14:02:27.841878 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 473/920] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:27 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:28.849695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:28.851114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:28.857303 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:28.858042 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:28.859067 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:28.859658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:29.091151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:29.100372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:29.101948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:29.103783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2ed72e50-7b3a-43fc-ac63-29d5a2b3c849 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.257897 Aug 04 14:02:29.116110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 448/921] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:28 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:30.125251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:30.126641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:30.133085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:30.133680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:30.134669 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:30.135204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:30.403734 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:30.412354 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:30.414202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:30.415596 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7acc1fd8-ecbc-4fca-991d-33333b6bff8a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.296404 Aug 04 14:02:30.416278 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 474/922] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:30 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:31.435459 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:31.437040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:31.450152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:31.450657 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:31.458835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:31.458835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:31.664708 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:31.679051 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:31.683953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:31.687665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f0f2b681-76b2-47b9-9ad2-8924c518eb5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.256251 Aug 04 14:02:31.701693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 449/923] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:31 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:32.715794 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:32.718973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:32.733183 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:32.734465 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:32.736373 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:32.737640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:32.966053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.977010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.979887 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.981424 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cd084f6c-a859-44c7-acf5-2de5f53e0167 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.274516 Aug 04 14:02:32.996621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 475/924] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:32 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:34.001375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:34.001913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:34.014584 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:34.015043 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:34.015939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:34.016487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:34.583158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.594066 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.596104 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.597535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4be9c5c5-6879-4060-9f86-50300cc0cf90 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.600042 Aug 04 14:02:34.598670 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 450/925] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:33 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:35.616782 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:35.618929 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:35.627182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:35.628041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:35.629088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:35.629936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:35.943229 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:35.956880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:35.968144 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:35.969702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a0d7cb81-8222-4457-ba6e-f069225507e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.356721 Aug 04 14:02:35.970798 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 476/926] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:35 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:36.610785 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c4ddf4b2-7e94-41cb-9018-f8ce319d2955 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:36.611283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c4ddf4b2-7e94-41cb-9018-f8ce319d2955 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:36.626996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c4ddf4b2-7e94-41cb-9018-f8ce319d2955 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:36.627442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c4ddf4b2-7e94-41cb-9018-f8ce319d2955 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:36.631223 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c4ddf4b2-7e94-41cb-9018-f8ce319d2955 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:36.631990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c4ddf4b2-7e94-41cb-9018-f8ce319d2955 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:36.664591 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c4ddf4b2-7e94-41cb-9018-f8ce319d2955 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:02:36.782197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c4ddf4b2-7e94-41cb-9018-f8ce319d2955 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 204 len: 0 microversion: 2.1 time: 0.174874 Aug 04 14:02:36.783565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 451/927] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:02:36 2021] DELETE /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:36.792643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ab65b8ef-dc70-457f-8e0e-5470d0f6f637 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:36.794376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ab65b8ef-dc70-457f-8e0e-5470d0f6f637 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:36.801028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ab65b8ef-dc70-457f-8e0e-5470d0f6f637 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:36.801843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ab65b8ef-dc70-457f-8e0e-5470d0f6f637 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:36.802880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ab65b8ef-dc70-457f-8e0e-5470d0f6f637 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:36.803534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ab65b8ef-dc70-457f-8e0e-5470d0f6f637 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:36.958229 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ab65b8ef-dc70-457f-8e0e-5470d0f6f637 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:36.966361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ab65b8ef-dc70-457f-8e0e-5470d0f6f637 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1513 microversion: 2.1 time: 0.178537 Aug 04 14:02:36.966943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 477/928] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:36 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:36.995734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:36.996702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:37.002829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:37.006735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:37.007816 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:37.009009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:37.205672 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:37.216863 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:37.218774 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:37.221568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-166dbd1c-8755-404d-a7ad-7483389b3a10 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.229374 Aug 04 14:02:37.221568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 452/929] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:36 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:37.983990 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1f043446-d7a6-40dd-a840-61c76aefaffb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:37.984753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1f043446-d7a6-40dd-a840-61c76aefaffb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:37.991843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f043446-d7a6-40dd-a840-61c76aefaffb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:37.992369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f043446-d7a6-40dd-a840-61c76aefaffb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:37.993503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f043446-d7a6-40dd-a840-61c76aefaffb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:37.994247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f043446-d7a6-40dd-a840-61c76aefaffb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:38.185250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1f043446-d7a6-40dd-a840-61c76aefaffb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:38.193158 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1f043446-d7a6-40dd-a840-61c76aefaffb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1513 microversion: 2.1 time: 0.212539 Aug 04 14:02:38.194722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 478/930] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:37 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:38.238837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:38.239445 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:38.247873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:38.248351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:38.249361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:38.249960 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:38.453098 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:38.461628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:38.463185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:38.467853 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7193d0db-f651-400a-a8c3-8636c3cf5053 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.232648 Aug 04 14:02:38.469910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 453/931] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:38 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:39.210056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-529e9770-f0fe-44e1-b1b2-e5432395528c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:39.211493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-529e9770-f0fe-44e1-b1b2-e5432395528c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:39.218506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-529e9770-f0fe-44e1-b1b2-e5432395528c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:39.219298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-529e9770-f0fe-44e1-b1b2-e5432395528c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:39.220161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-529e9770-f0fe-44e1-b1b2-e5432395528c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:39.221404 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-529e9770-f0fe-44e1-b1b2-e5432395528c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:39.390994 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-529e9770-f0fe-44e1-b1b2-e5432395528c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.416700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-529e9770-f0fe-44e1-b1b2-e5432395528c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1513 microversion: 2.1 time: 0.209701 Aug 04 14:02:39.419308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 479/932] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:39 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:39.487508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:39.488115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:39.502002 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:39.502455 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:39.503264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:39.503702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:39.773027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.805089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.806512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.814812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0a7bb02c-a673-49c2-b6d2-580dbfe26bf7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.330904 Aug 04 14:02:39.829829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 454/933] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:39 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:40.437241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:40.437852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:40.453574 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:40.455502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:40.457391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:40.458165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:40.513976 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:40.515164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:40.515814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lazy-loading 'fault' on Instance uuid 2690b010-926e-4e5e-ae24-f0e14a968d86 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:02:40.570514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-bcefeb58-a9ef-41f0-baf0-0078c41ac6a9 req-de19b4f8-3bf6-4b42-a1be-e7b47ab937e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2690b010-926e-4e5e-ae24-f0e14a968d86", "name": "network-vif-deleted", "tag": "e58a7a3a-6a1b-406f-bc99-b15c2b8d7059"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:40.572176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:02:40.572176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:02:40.584625 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-bcefeb58-a9ef-41f0-baf0-0078c41ac6a9 req-de19b4f8-3bf6-4b42-a1be-e7b47ab937e6 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:40.585880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-bcefeb58-a9ef-41f0-baf0-0078c41ac6a9 req-de19b4f8-3bf6-4b42-a1be-e7b47ab937e6 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:40.600021 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-bcefeb58-a9ef-41f0-baf0-0078c41ac6a9 req-de19b4f8-3bf6-4b42-a1be-e7b47ab937e6 service nova] Creating event network-vif-deleted:e58a7a3a-6a1b-406f-bc99-b15c2b8d7059 for instance 2690b010-926e-4e5e-ae24-f0e14a968d86 on hv-cinder-79264 Aug 04 14:02:40.606161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-bcefeb58-a9ef-41f0-baf0-0078c41ac6a9 req-de19b4f8-3bf6-4b42-a1be-e7b47ab937e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373478 Aug 04 14:02:40.608068 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 480/934] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:02:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:40.618452 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:40.626629 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7b831e37-4e19-411e-9408-f8c551fc3aa5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 200 len: 1308 microversion: 2.1 time: 0.195672 Aug 04 14:02:40.627231 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 455/935] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:40 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:40.835244 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:40.836025 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:40.857610 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:40.858154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:40.859132 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:40.859579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:41.116876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:41.129671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:41.131418 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:41.132899 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6d73c608-9fea-42b8-a72e-1944c7c46357 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.302300 Aug 04 14:02:41.134139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 481/936] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:40 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:41.647649 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:41.648392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: 2690b010-926e-4e5e-ae24-f0e14a968d86] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:41.657210 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:41.657403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:41.658497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:41.659109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:41.704381 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] HTTP exception thrown: Instance 2690b010-926e-4e5e-ae24-f0e14a968d86 could not be found. Aug 04 14:02:41.705943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Returning 404 to user: Instance 2690b010-926e-4e5e-ae24-f0e14a968d86 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:02:41.707552 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c5341e85-7f3b-46f7-b818-5a711b894fe0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86" status: 404 len: 111 microversion: 2.1 time: 0.065588 Aug 04 14:02:41.710094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 456/937] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:41 2021] GET /compute/v2.1/servers/2690b010-926e-4e5e-ae24-f0e14a968d86 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:02:42.155250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:42.156869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:42.182780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:42.183545 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:42.190138 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:42.190918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:42.484693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:42.495919 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:42.501973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:42.503565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d7dfbee9-0e16-4052-8a9e-0432acd30a24 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.354505 Aug 04 14:02:42.504292 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 482/938] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:42 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:42.866534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bb330020-338e-418b-baef-1f8f873b420f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:42.867478 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bb330020-338e-418b-baef-1f8f873b420f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:42.891127 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bb330020-338e-418b-baef-1f8f873b420f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:42.891966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bb330020-338e-418b-baef-1f8f873b420f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:42.893539 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bb330020-338e-418b-baef-1f8f873b420f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:42.896470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bb330020-338e-418b-baef-1f8f873b420f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:42.955178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bb330020-338e-418b-baef-1f8f873b420f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:02:43.098028 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bb330020-338e-418b-baef-1f8f873b420f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 204 len: 0 microversion: 2.1 time: 0.462008 Aug 04 14:02:43.098648 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 457/939] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:02:42 2021] DELETE /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:43.110875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-33aeebc3-ade2-4108-9f6b-c4ff8905b360 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:43.111832 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-33aeebc3-ade2-4108-9f6b-c4ff8905b360 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:43.118449 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33aeebc3-ade2-4108-9f6b-c4ff8905b360 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:43.119204 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33aeebc3-ade2-4108-9f6b-c4ff8905b360 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:43.120614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33aeebc3-ade2-4108-9f6b-c4ff8905b360 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:43.121334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33aeebc3-ade2-4108-9f6b-c4ff8905b360 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:43.281382 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-33aeebc3-ade2-4108-9f6b-c4ff8905b360 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:43.289742 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-33aeebc3-ade2-4108-9f6b-c4ff8905b360 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.185653 Aug 04 14:02:43.291159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 483/940] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:43 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:43.523883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:43.524523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:43.536373 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:43.536850 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:43.537673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:43.538305 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:43.733112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:43.742593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:43.745188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:43.746489 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1c2e091d-0dd1-4fa8-92ca-79a0142fa841 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.226523 Aug 04 14:02:43.757045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 458/941] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:43 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:44.310036 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4075f6a3-0a78-43f8-910e-b1e1922799c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:44.311686 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4075f6a3-0a78-43f8-910e-b1e1922799c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:44.322609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4075f6a3-0a78-43f8-910e-b1e1922799c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:44.323894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4075f6a3-0a78-43f8-910e-b1e1922799c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:44.325052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4075f6a3-0a78-43f8-910e-b1e1922799c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:44.325630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4075f6a3-0a78-43f8-910e-b1e1922799c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:44.493252 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4075f6a3-0a78-43f8-910e-b1e1922799c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:44.502788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4075f6a3-0a78-43f8-910e-b1e1922799c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.197764 Aug 04 14:02:44.509029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 484/942] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:44 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:44.765047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:44.765996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:44.774474 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:44.774945 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:44.776377 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:44.776926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:44.925854 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:44.939546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:44.942235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:44.942609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-aff93f93-dfc2-417b-8afc-1acba7e9ee78 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.182020 Aug 04 14:02:44.943438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 459/943] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:44 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:45.525059 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-07113e65-9042-4097-9c84-5639e25a1911 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:45.526851 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-07113e65-9042-4097-9c84-5639e25a1911 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:45.534973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07113e65-9042-4097-9c84-5639e25a1911 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:45.535978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07113e65-9042-4097-9c84-5639e25a1911 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:45.537068 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07113e65-9042-4097-9c84-5639e25a1911 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:45.537714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07113e65-9042-4097-9c84-5639e25a1911 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:45.722809 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-07113e65-9042-4097-9c84-5639e25a1911 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:45.737513 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-07113e65-9042-4097-9c84-5639e25a1911 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.219032 Aug 04 14:02:45.763164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 485/944] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:45 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:45.961490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:45.964618 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:45.975762 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:45.976199 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:45.977046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:45.977485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:46.164782 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:46.176769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:46.178825 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:46.180265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a2f8fb60-316b-4584-a7b4-6fcb558c18b5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.222625 Aug 04 14:02:46.181080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 460/945] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:45 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:46.773652 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-892f192a-8063-409d-bca9-c7de56d11207 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:46.774800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-892f192a-8063-409d-bca9-c7de56d11207 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:46.785234 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-892f192a-8063-409d-bca9-c7de56d11207 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:46.787057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-892f192a-8063-409d-bca9-c7de56d11207 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:46.788827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-892f192a-8063-409d-bca9-c7de56d11207 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:46.789868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-892f192a-8063-409d-bca9-c7de56d11207 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:47.001516 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-892f192a-8063-409d-bca9-c7de56d11207 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:47.019307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-892f192a-8063-409d-bca9-c7de56d11207 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.251439 Aug 04 14:02:47.020547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 486/946] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:46 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:47.201151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:47.201861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:47.211056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:47.211832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:47.213486 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:47.214182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:47.419951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:47.433343 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:47.435784 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:47.437022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-284e7a5c-3fc6-4fd0-94f4-32bdde5f3fd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.240236 Aug 04 14:02:47.437813 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 461/947] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:47 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:48.057163 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d6c00486-f001-4c4d-8166-df919b67087e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:48.059410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d6c00486-f001-4c4d-8166-df919b67087e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:48.072386 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d6c00486-f001-4c4d-8166-df919b67087e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:48.073668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d6c00486-f001-4c4d-8166-df919b67087e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:48.075069 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d6c00486-f001-4c4d-8166-df919b67087e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:48.075667 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d6c00486-f001-4c4d-8166-df919b67087e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:48.295782 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d6c00486-f001-4c4d-8166-df919b67087e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:48.315065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d6c00486-f001-4c4d-8166-df919b67087e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.269288 Aug 04 14:02:48.315728 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 487/948] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:48 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:48.469386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:48.470436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:48.481300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:48.482101 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:48.486597 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:48.487378 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:48.595145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4b80c556-57d7-4f03-8852-7dd9da91ba08 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Action: 'create', calling method: .version_select at 0x7efe7c4c6af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-934605651"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:48.621335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-4b80c556-57d7-4f03-8852-7dd9da91ba08 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Getting quotas for project 0bd8064518c746d397f5d10d94300938. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:02:48.626196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-4b80c556-57d7-4f03-8852-7dd9da91ba08 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Getting quotas for user fd30a4a2aaf541be9793ab2964b1662c and project 0bd8064518c746d397f5d10d94300938. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:02:49.010951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:49.024385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-4b80c556-57d7-4f03-8852-7dd9da91ba08 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Getting quotas for project 0bd8064518c746d397f5d10d94300938. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:02:49.024678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:49.027030 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:49.028673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-df6439bc-f0e9-4f80-a8f7-a2f69813d029 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.566221 Aug 04 14:02:49.029725 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 462/949] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:48 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:49.036099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-4b80c556-57d7-4f03-8852-7dd9da91ba08 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Getting quotas for user fd30a4a2aaf541be9793ab2964b1662c and project 0bd8064518c746d397f5d10d94300938. Resources: {'key_pairs'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:02:49.058213 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4b80c556-57d7-4f03-8852-7dd9da91ba08 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.466635 Aug 04 14:02:49.059174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 488/950] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Aug 4 14:02:48 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:49.120341 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1636205761", "imageRef": "7decc468-0d26-494a-bb82-00e067aad330", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-934605651", "networks": [{"uuid": "a13b33cd-0ccc-4704-9ae6-811186cc2ef5"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:49.193067 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] validate_networks() for [('a13b33cd-0ccc-4704-9ae6-811186cc2ef5', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:02:49.338870 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1bb71580-eae1-4799-bf9a-2311b39be9ea tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:49.340427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1bb71580-eae1-4799-bf9a-2311b39be9ea tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:49.351304 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1bb71580-eae1-4799-bf9a-2311b39be9ea tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:49.352129 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1bb71580-eae1-4799-bf9a-2311b39be9ea tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:49.353697 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1bb71580-eae1-4799-bf9a-2311b39be9ea tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:49.354795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1bb71580-eae1-4799-bf9a-2311b39be9ea tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:49.555186 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1bb71580-eae1-4799-bf9a-2311b39be9ea tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:49.566612 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1bb71580-eae1-4799-bf9a-2311b39be9ea tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.236165 Aug 04 14:02:49.577409 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 489/951] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:49 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:49.960496 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:02:49.960993 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:02:49.961409 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:02:49.961814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:02:49.962228 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:02:49.975007 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:49.975814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:49.977266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:49.977979 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:50.002057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Getting quotas for project 0bd8064518c746d397f5d10d94300938. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:02:50.006522 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Getting quotas for user fd30a4a2aaf541be9793ab2964b1662c and project 0bd8064518c746d397f5d10d94300938. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:02:50.023605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:02:50.026852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7decc468-0d26-494a-bb82-00e067aad330',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:02:50.051772 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:50.052582 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:50.059402 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:50.060499 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:50.060758 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:50.061195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:50.079837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-adbf9ce6-887d-4c59-8186-d1eceda6b15a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967036 Aug 04 14:02:50.080743 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 463/952] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:02:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:02:50.096779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c2c66b9a-28ae-4fdb-bfa3-dbe6e513f3ba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:50.098359 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c2c66b9a-28ae-4fdb-bfa3-dbe6e513f3ba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:50.173189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c2c66b9a-28ae-4fdb-bfa3-dbe6e513f3ba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:50.183270 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c2c66b9a-28ae-4fdb-bfa3-dbe6e513f3ba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1258 microversion: 2.1 time: 0.096237 Aug 04 14:02:50.194186 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 464/953] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:50 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:50.214136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:50.224307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:50.225999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:50.228178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1861ee57-f818-4932-bc90-41dd29915961 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.179492 Aug 04 14:02:50.228178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 490/954] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:50 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:50.585228 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ea71a9a1-23bb-4534-8084-278e25862b81 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:50.586190 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ea71a9a1-23bb-4534-8084-278e25862b81 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:50.594478 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ea71a9a1-23bb-4534-8084-278e25862b81 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:50.595254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ea71a9a1-23bb-4534-8084-278e25862b81 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:50.596940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ea71a9a1-23bb-4534-8084-278e25862b81 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:50.597712 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ea71a9a1-23bb-4534-8084-278e25862b81 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:50.796906 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ea71a9a1-23bb-4534-8084-278e25862b81 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:50.805550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ea71a9a1-23bb-4534-8084-278e25862b81 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.224204 Aug 04 14:02:50.806219 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 465/955] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:50 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:51.203319 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5510e1ac-82c8-4f80-97e3-c11e899bce36 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:51.204147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5510e1ac-82c8-4f80-97e3-c11e899bce36 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:51.210167 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5510e1ac-82c8-4f80-97e3-c11e899bce36 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:51.210611 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5510e1ac-82c8-4f80-97e3-c11e899bce36 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:51.211400 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5510e1ac-82c8-4f80-97e3-c11e899bce36 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:51.211827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5510e1ac-82c8-4f80-97e3-c11e899bce36 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:51.246924 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:51.247808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:51.258828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:51.260350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:51.262109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:51.263015 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:51.298187 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5510e1ac-82c8-4f80-97e3-c11e899bce36 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:51.307134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5510e1ac-82c8-4f80-97e3-c11e899bce36 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1254 microversion: 2.1 time: 0.107631 Aug 04 14:02:51.308262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 491/956] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:51 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1254 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:51.435742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:51.451953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:51.453867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:51.455097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-614b6602-1eb8-4707-9992-d8e292f4182c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.212868 Aug 04 14:02:51.455697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 466/957] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:51 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:51.825086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6785541f-8f0a-454c-83e0-9ef2fd32a59c tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:51.825701 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6785541f-8f0a-454c-83e0-9ef2fd32a59c tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:51.832074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6785541f-8f0a-454c-83e0-9ef2fd32a59c tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:51.832561 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6785541f-8f0a-454c-83e0-9ef2fd32a59c tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:51.833347 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6785541f-8f0a-454c-83e0-9ef2fd32a59c tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:51.833771 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6785541f-8f0a-454c-83e0-9ef2fd32a59c tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:52.008556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6785541f-8f0a-454c-83e0-9ef2fd32a59c tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:52.018707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6785541f-8f0a-454c-83e0-9ef2fd32a59c tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.198083 Aug 04 14:02:52.019294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 492/958] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:51 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:52.333665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3b525241-3536-479a-a4d7-31172c96bd2a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:52.334695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3b525241-3536-479a-a4d7-31172c96bd2a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:52.345924 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3b525241-3536-479a-a4d7-31172c96bd2a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:52.346693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3b525241-3536-479a-a4d7-31172c96bd2a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:52.348090 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3b525241-3536-479a-a4d7-31172c96bd2a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:52.348886 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3b525241-3536-479a-a4d7-31172c96bd2a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:52.441832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3b525241-3536-479a-a4d7-31172c96bd2a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:52.451303 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3b525241-3536-479a-a4d7-31172c96bd2a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1254 microversion: 2.1 time: 0.124738 Aug 04 14:02:52.452142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 467/959] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:52 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1254 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:52.474533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:52.475131 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:52.485217 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:52.485881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:52.487313 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:52.488026 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:52.669423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:52.678876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:52.680563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:52.682671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-acf95839-63b9-4110-b9db-7bb47e683d98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.211444 Aug 04 14:02:52.683487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 493/960] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:52 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:53.045912 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b1c0edb5-a4da-4f30-ba4f-379841c7dc12 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:53.046509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b1c0edb5-a4da-4f30-ba4f-379841c7dc12 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:53.052497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b1c0edb5-a4da-4f30-ba4f-379841c7dc12 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:53.052939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b1c0edb5-a4da-4f30-ba4f-379841c7dc12 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:53.053720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b1c0edb5-a4da-4f30-ba4f-379841c7dc12 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:53.054158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b1c0edb5-a4da-4f30-ba4f-379841c7dc12 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:53.187990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b1c0edb5-a4da-4f30-ba4f-379841c7dc12 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:53.196370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b1c0edb5-a4da-4f30-ba4f-379841c7dc12 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.155006 Aug 04 14:02:53.197127 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 468/961] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:53 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:53.469194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-580856ec-0075-4008-87d6-ee4760a2e3e2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:53.469915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-580856ec-0075-4008-87d6-ee4760a2e3e2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:53.476300 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-580856ec-0075-4008-87d6-ee4760a2e3e2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:53.476977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-580856ec-0075-4008-87d6-ee4760a2e3e2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:53.477555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-580856ec-0075-4008-87d6-ee4760a2e3e2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:53.477992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-580856ec-0075-4008-87d6-ee4760a2e3e2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:53.543339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-580856ec-0075-4008-87d6-ee4760a2e3e2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:53.551447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-580856ec-0075-4008-87d6-ee4760a2e3e2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1254 microversion: 2.1 time: 0.086219 Aug 04 14:02:53.552144 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 494/962] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:53 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1254 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:53.702370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:53.703047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:53.709457 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:53.709966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:53.710893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:53.711546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:53.854228 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:53.864464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:53.866065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:53.867355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b66b538d-e8aa-4a93-9b1a-2df8df23f774 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.168841 Aug 04 14:02:53.868011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 469/963] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:53 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:54.223501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f0ad283f-960b-45be-9752-4ace565fad01 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.224112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f0ad283f-960b-45be-9752-4ace565fad01 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:54.231336 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f0ad283f-960b-45be-9752-4ace565fad01 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:54.231911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f0ad283f-960b-45be-9752-4ace565fad01 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:54.232981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f0ad283f-960b-45be-9752-4ace565fad01 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:54.233733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f0ad283f-960b-45be-9752-4ace565fad01 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:54.402579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f0ad283f-960b-45be-9752-4ace565fad01 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:54.416407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f0ad283f-960b-45be-9752-4ace565fad01 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.196524 Aug 04 14:02:54.417376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 495/964] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:54 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:54.594229 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fbde81fe-58a8-4f0c-bebb-f090e470d1a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.604185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-9e8b4395-6f29-4d4c-8251-b0b499915fac req-0165a319-9fe9-471d-a0ab-01c4cb104086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f674980e-9f84-4659-bbd4-114786775944", "name": "network-vif-unplugged", "status": "completed", "tag": "2291b3bf-fa3c-4988-994b-0bdcb2e3ed75"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:54.606080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:02:54.606080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:02:54.608133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fbde81fe-58a8-4f0c-bebb-f090e470d1a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:54.614185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-9e8b4395-6f29-4d4c-8251-b0b499915fac req-0165a319-9fe9-471d-a0ab-01c4cb104086 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:54.614817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-9e8b4395-6f29-4d4c-8251-b0b499915fac req-0165a319-9fe9-471d-a0ab-01c4cb104086 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:54.617121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fbde81fe-58a8-4f0c-bebb-f090e470d1a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:54.618113 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fbde81fe-58a8-4f0c-bebb-f090e470d1a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:54.619838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fbde81fe-58a8-4f0c-bebb-f090e470d1a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:54.620634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fbde81fe-58a8-4f0c-bebb-f090e470d1a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:54.629542 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-9e8b4395-6f29-4d4c-8251-b0b499915fac req-0165a319-9fe9-471d-a0ab-01c4cb104086 service nova] Creating event network-vif-unplugged:2291b3bf-fa3c-4988-994b-0bdcb2e3ed75 for instance f674980e-9f84-4659-bbd4-114786775944 on hv-cinder-79264 Aug 04 14:02:54.636048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-9e8b4395-6f29-4d4c-8251-b0b499915fac req-0165a319-9fe9-471d-a0ab-01c4cb104086 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142930 Aug 04 14:02:54.637124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 470/965] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:02:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:54.724000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fbde81fe-58a8-4f0c-bebb-f090e470d1a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:54.733536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fbde81fe-58a8-4f0c-bebb-f090e470d1a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1310 microversion: 2.1 time: 0.167135 Aug 04 14:02:54.734353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 496/966] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:54 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1310 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:54.887516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.888106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:54.894903 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:54.895351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:54.896150 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:54.896647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:55.047582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:55.057490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:55.059033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:55.060246 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-608501dc-d583-48f6-a4a7-90a7241651ed tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.177735 Aug 04 14:02:55.060961 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 471/967] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:54 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:55.435114 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c015b78c-27a9-4492-bf8c-7ce1fa1559c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:55.435796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c015b78c-27a9-4492-bf8c-7ce1fa1559c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:55.442644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c015b78c-27a9-4492-bf8c-7ce1fa1559c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:55.443096 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c015b78c-27a9-4492-bf8c-7ce1fa1559c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:55.443952 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c015b78c-27a9-4492-bf8c-7ce1fa1559c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:55.444432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c015b78c-27a9-4492-bf8c-7ce1fa1559c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:55.761070 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b7187179-f385-46b0-8d5f-c3eb9560128c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:55.761847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b7187179-f385-46b0-8d5f-c3eb9560128c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:55.784537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b7187179-f385-46b0-8d5f-c3eb9560128c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:55.785121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b7187179-f385-46b0-8d5f-c3eb9560128c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:55.789210 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b7187179-f385-46b0-8d5f-c3eb9560128c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:55.789929 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b7187179-f385-46b0-8d5f-c3eb9560128c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:55.818521 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c015b78c-27a9-4492-bf8c-7ce1fa1559c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:55.842477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c015b78c-27a9-4492-bf8c-7ce1fa1559c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1577 microversion: 2.1 time: 0.411398 Aug 04 14:02:55.844183 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 497/968] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:55 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1577 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:55.896722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b7187179-f385-46b0-8d5f-c3eb9560128c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:55.910705 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b7187179-f385-46b0-8d5f-c3eb9560128c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1316 microversion: 2.1 time: 0.153665 Aug 04 14:02:55.912397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 472/969] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:55 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:56.085987 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:56.087660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:56.102605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:56.104744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:56.106845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:56.107903 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:56.325482 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1529605286", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "8cf8a406-b1f1-48fb-9af7-a87613bf1591"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:56.483470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] validate_networks() for [('8cf8a406-b1f1-48fb-9af7-a87613bf1591', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:02:56.645055 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:56.680127 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:56.686006 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:56.688179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5ef1ba17-474b-4ba9-a3c3-c1440edfca2d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.609468 Aug 04 14:02:56.696129 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 498/970] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:56 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:56.873322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b4b61ba9-0024-480d-b43c-c58c969e22c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:56.879164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b4b61ba9-0024-480d-b43c-c58c969e22c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:56.913232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4b61ba9-0024-480d-b43c-c58c969e22c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:56.914066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4b61ba9-0024-480d-b43c-c58c969e22c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:56.915551 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4b61ba9-0024-480d-b43c-c58c969e22c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:56.916468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4b61ba9-0024-480d-b43c-c58c969e22c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:57.138342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b4b61ba9-0024-480d-b43c-c58c969e22c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:57.149770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b4b61ba9-0024-480d-b43c-c58c969e22c9 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1509 microversion: 2.1 time: 0.292058 Aug 04 14:02:57.172650 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 499/971] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:56 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:57.184558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-361abbd7-a8c5-4b86-99f0-df85c5e6dea0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:57.185522 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-361abbd7-a8c5-4b86-99f0-df85c5e6dea0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:57.205866 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-361abbd7-a8c5-4b86-99f0-df85c5e6dea0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:57.214205 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-361abbd7-a8c5-4b86-99f0-df85c5e6dea0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:57.215370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-361abbd7-a8c5-4b86-99f0-df85c5e6dea0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:57.218482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-361abbd7-a8c5-4b86-99f0-df85c5e6dea0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:57.444986 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-361abbd7-a8c5-4b86-99f0-df85c5e6dea0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:57.456401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-361abbd7-a8c5-4b86-99f0-df85c5e6dea0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1316 microversion: 2.1 time: 0.282545 Aug 04 14:02:57.457752 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 500/972] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:57 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:57.481139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-aa86a923-2db6-4438-965d-1b087fb917d8 req-bc911660-2c42-4dab-b78b-8d56f77a4ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f674980e-9f84-4659-bbd4-114786775944", "name": "network-vif-deleted", "tag": "2291b3bf-fa3c-4988-994b-0bdcb2e3ed75"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:57.487421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:02:57.487421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:02:57.505740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-aa86a923-2db6-4438-965d-1b087fb917d8 req-bc911660-2c42-4dab-b78b-8d56f77a4ad3 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:57.508343 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-aa86a923-2db6-4438-965d-1b087fb917d8 req-bc911660-2c42-4dab-b78b-8d56f77a4ad3 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:57.551758 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-aa86a923-2db6-4438-965d-1b087fb917d8 req-bc911660-2c42-4dab-b78b-8d56f77a4ad3 service nova] Creating event network-vif-deleted:2291b3bf-fa3c-4988-994b-0bdcb2e3ed75 for instance f674980e-9f84-4659-bbd4-114786775944 on hv-cinder-79264 Aug 04 14:02:57.567703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-aa86a923-2db6-4438-965d-1b087fb917d8 req-bc911660-2c42-4dab-b78b-8d56f77a4ad3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108329 Aug 04 14:02:57.575705 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 501/973] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:02:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:57.614316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:02:57.616034 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:02:57.624000 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:02:57.633085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:02:57.641848 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:02:57.711367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:57.713508 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:57.731556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:57.732621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:57.733745 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:57.742063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:57.745510 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:57.752278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:57.759696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:57.765441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:57.884784 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Getting quotas for project 46936a5606ce4e148713e2709548faaa. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:02:57.961265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Getting quotas for user 9d38a2823d944bc8bace34cc344960e2 and project 46936a5606ce4e148713e2709548faaa. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:02:58.021397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:02:58.029172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:02:58.209467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4a41d800-ee1b-47e2-8fda-d919581685d6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890164 Aug 04 14:02:58.211438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 473/974] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:02:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 1894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:02:58.252683 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-feeac7eb-79e3-4b0d-9e0a-63b548247042 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:58.254555 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-feeac7eb-79e3-4b0d-9e0a-63b548247042 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:58.277824 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feeac7eb-79e3-4b0d-9e0a-63b548247042 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:58.293904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feeac7eb-79e3-4b0d-9e0a-63b548247042 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:58.303986 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feeac7eb-79e3-4b0d-9e0a-63b548247042 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:58.304805 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feeac7eb-79e3-4b0d-9e0a-63b548247042 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:58.442825 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-feeac7eb-79e3-4b0d-9e0a-63b548247042 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.452391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-feeac7eb-79e3-4b0d-9e0a-63b548247042 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.238785 Aug 04 14:02:58.459313 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 474/975] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:58 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:58.472659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e315c16f-5bae-41dd-8c76-cf404058983c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:58.473439 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.477994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e315c16f-5bae-41dd-8c76-cf404058983c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:58.546474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.555956 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.559834 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c766ba97-5a75-41ba-aa1f-6f677d86236f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.852474 Aug 04 14:02:58.561648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 502/976] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:57 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:02:58.571223 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3d522950-b06d-4d66-8f15-0da2b03fece3 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:58.573936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3d522950-b06d-4d66-8f15-0da2b03fece3 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:58.586152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d522950-b06d-4d66-8f15-0da2b03fece3 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:58.587673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d522950-b06d-4d66-8f15-0da2b03fece3 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:58.589823 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d522950-b06d-4d66-8f15-0da2b03fece3 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:58.591138 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d522950-b06d-4d66-8f15-0da2b03fece3 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:58.640060 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e315c16f-5bae-41dd-8c76-cf404058983c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.648112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e315c16f-5bae-41dd-8c76-cf404058983c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1219 microversion: 2.1 time: 0.183152 Aug 04 14:02:58.648991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 475/977] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:58 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:59.048934 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3d522950-b06d-4d66-8f15-0da2b03fece3 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:59.070877 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3d522950-b06d-4d66-8f15-0da2b03fece3 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.506459 Aug 04 14:02:59.077508 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 503/978] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:58 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:59.476707 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fcc363e6-4e14-48e6-a028-c9395f8aa032 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:59.477722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fcc363e6-4e14-48e6-a028-c9395f8aa032 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:59.486473 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fcc363e6-4e14-48e6-a028-c9395f8aa032 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:59.487162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fcc363e6-4e14-48e6-a028-c9395f8aa032 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:59.489074 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fcc363e6-4e14-48e6-a028-c9395f8aa032 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:59.490111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fcc363e6-4e14-48e6-a028-c9395f8aa032 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:59.584261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:59.593076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:59.616282 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:59.618416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:59.620874 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fcc363e6-4e14-48e6-a028-c9395f8aa032 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:59.621188 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:59.622071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:59.633113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fcc363e6-4e14-48e6-a028-c9395f8aa032 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.160122 Aug 04 14:02:59.644875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 476/979] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:59 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:59.667981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-49f14388-8505-477c-bd58-58c79df49396 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:59.670815 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-49f14388-8505-477c-bd58-58c79df49396 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:02:59.695563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-49f14388-8505-477c-bd58-58c79df49396 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:59.696860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-49f14388-8505-477c-bd58-58c79df49396 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:59.698944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-49f14388-8505-477c-bd58-58c79df49396 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:59.699775 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-49f14388-8505-477c-bd58-58c79df49396 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:59.857057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-49f14388-8505-477c-bd58-58c79df49396 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:59.866792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-49f14388-8505-477c-bd58-58c79df49396 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.202880 Aug 04 14:02:59.872419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 477/980] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:02:59 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:59.885173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-40db2c79-0272-4570-aac4-5752837d6af8 req-b6f43375-58ea-4966-81de-9da5165bc150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a6e241-9234-4ca1-b4ca-7b90733ab705", "name": "network-vif-plugged", "status": "completed", "tag": "828cc1c2-4556-4cd2-a0e7-2ed9383548e4"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:59.887239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:02:59.887239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:02:59.898742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-40db2c79-0272-4570-aac4-5752837d6af8 req-b6f43375-58ea-4966-81de-9da5165bc150 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:02:59.899200 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-40db2c79-0272-4570-aac4-5752837d6af8 req-b6f43375-58ea-4966-81de-9da5165bc150 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:02:59.921302 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-40db2c79-0272-4570-aac4-5752837d6af8 req-b6f43375-58ea-4966-81de-9da5165bc150 service nova] Creating event network-vif-plugged:828cc1c2-4556-4cd2-a0e7-2ed9383548e4 for instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 on hv-cinder-79264 Aug 04 14:02:59.936920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-40db2c79-0272-4570-aac4-5752837d6af8 req-b6f43375-58ea-4966-81de-9da5165bc150 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056227 Aug 04 14:02:59.939454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 478/981] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:02:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:00.047759 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.059554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.060763 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.067041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7e4a3144-1d54-4ddd-bcbc-b3d04a672375 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.490224 Aug 04 14:03:00.068076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 504/982] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:02:59 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:00.106352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5a2def01-b423-4400-80da-c912eb31ded2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:00.107262 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5a2def01-b423-4400-80da-c912eb31ded2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:00.114408 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5a2def01-b423-4400-80da-c912eb31ded2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:00.115262 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5a2def01-b423-4400-80da-c912eb31ded2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:00.116391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5a2def01-b423-4400-80da-c912eb31ded2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:00.117054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5a2def01-b423-4400-80da-c912eb31ded2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:00.272283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5a2def01-b423-4400-80da-c912eb31ded2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.281549 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5a2def01-b423-4400-80da-c912eb31ded2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.179692 Aug 04 14:03:00.282896 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 479/983] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:00 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:00.328743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-32017b29-61f0-4280-ad87-12717928f77b req-10077892-d1be-4492-8efa-b93823f72ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246a1a60-bd1b-41f4-b264-35142d684f8d", "tag": "beceb660-6af5-4957-92be-e4d30ef7ad50"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:00.331971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:00.331971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:03:00.346084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-32017b29-61f0-4280-ad87-12717928f77b req-10077892-d1be-4492-8efa-b93823f72ebc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:00.347255 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-32017b29-61f0-4280-ad87-12717928f77b req-10077892-d1be-4492-8efa-b93823f72ebc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:00.375015 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-32017b29-61f0-4280-ad87-12717928f77b req-10077892-d1be-4492-8efa-b93823f72ebc service nova] Creating event network-changed:beceb660-6af5-4957-92be-e4d30ef7ad50 for instance 246a1a60-bd1b-41f4-b264-35142d684f8d on hv-cinder-79264 Aug 04 14:03:00.384920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-32017b29-61f0-4280-ad87-12717928f77b req-10077892-d1be-4492-8efa-b93823f72ebc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185488 Aug 04 14:03:00.388496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 505/984] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:00.652103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-73063740-e587-4860-87bf-4cc73dd2617e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:00.652947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-73063740-e587-4860-87bf-4cc73dd2617e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:00.660704 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73063740-e587-4860-87bf-4cc73dd2617e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:00.661467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73063740-e587-4860-87bf-4cc73dd2617e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:00.662831 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73063740-e587-4860-87bf-4cc73dd2617e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:00.663603 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73063740-e587-4860-87bf-4cc73dd2617e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:00.748196 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-73063740-e587-4860-87bf-4cc73dd2617e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.756254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-73063740-e587-4860-87bf-4cc73dd2617e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.108704 Aug 04 14:03:00.767778 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 480/985] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:00 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:00.885952 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2c73b32d-4696-442e-8512-6fc69a098351 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:00.886804 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2c73b32d-4696-442e-8512-6fc69a098351 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:00.893483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2c73b32d-4696-442e-8512-6fc69a098351 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:00.893838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2c73b32d-4696-442e-8512-6fc69a098351 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:00.894634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2c73b32d-4696-442e-8512-6fc69a098351 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:00.895065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2c73b32d-4696-442e-8512-6fc69a098351 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:00.961085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2c73b32d-4696-442e-8512-6fc69a098351 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.969091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2c73b32d-4696-442e-8512-6fc69a098351 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.088326 Aug 04 14:03:00.969672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 506/986] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:00 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:01.086322 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:01.086928 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:01.093721 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:01.094168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:01.094967 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:01.095402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:01.235367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:01.248268 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:01.251688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:01.253208 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-dd2f3887-ab89-4f7f-bb66-99ed22c49cd5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.170705 Aug 04 14:03:01.254030 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 481/987] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:01 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:01.311920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2586d960-0542-44b4-8e3b-b6ad108f7ef8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:01.313022 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2586d960-0542-44b4-8e3b-b6ad108f7ef8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:01.323096 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2586d960-0542-44b4-8e3b-b6ad108f7ef8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:01.323829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2586d960-0542-44b4-8e3b-b6ad108f7ef8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:01.325185 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2586d960-0542-44b4-8e3b-b6ad108f7ef8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:01.325953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2586d960-0542-44b4-8e3b-b6ad108f7ef8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:01.515106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2586d960-0542-44b4-8e3b-b6ad108f7ef8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:01.523404 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2586d960-0542-44b4-8e3b-b6ad108f7ef8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.218207 Aug 04 14:03:01.524005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 507/988] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:01 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:01.775277 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2e75aaf3-20ec-4493-ba4f-cad85177ba40 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:01.775812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2e75aaf3-20ec-4493-ba4f-cad85177ba40 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:01.782199 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e75aaf3-20ec-4493-ba4f-cad85177ba40 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:01.782720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e75aaf3-20ec-4493-ba4f-cad85177ba40 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:01.783437 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e75aaf3-20ec-4493-ba4f-cad85177ba40 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:01.783879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2e75aaf3-20ec-4493-ba4f-cad85177ba40 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:01.873736 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2e75aaf3-20ec-4493-ba4f-cad85177ba40 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:01.882450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2e75aaf3-20ec-4493-ba4f-cad85177ba40 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.111049 Aug 04 14:03:01.883223 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 482/989] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:01 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:01.986796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-263520c4-8957-408a-a56f-4f699f553244 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:01.987481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-263520c4-8957-408a-a56f-4f699f553244 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:01.994336 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-263520c4-8957-408a-a56f-4f699f553244 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:01.994793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-263520c4-8957-408a-a56f-4f699f553244 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:01.995623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-263520c4-8957-408a-a56f-4f699f553244 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:01.996054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-263520c4-8957-408a-a56f-4f699f553244 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:02.063080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-263520c4-8957-408a-a56f-4f699f553244 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:02.074563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-263520c4-8957-408a-a56f-4f699f553244 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.091477 Aug 04 14:03:02.075185 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 508/990] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:01 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:02.278059 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:02.278684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:02.285014 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:02.285452 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:02.286266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:02.286697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:02.434725 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:02.443568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:02.445430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:02.446939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9093ae5c-c4d3-4999-a4e7-04c0f75990d9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.173927 Aug 04 14:03:02.448116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 483/991] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:02 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:03:02.547306 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-664cfbae-92a8-48be-9f68-3e8222b4c625 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:02.548046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-664cfbae-92a8-48be-9f68-3e8222b4c625 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:02.555322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-664cfbae-92a8-48be-9f68-3e8222b4c625 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:02.555941 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-664cfbae-92a8-48be-9f68-3e8222b4c625 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:02.557398 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-664cfbae-92a8-48be-9f68-3e8222b4c625 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:02.557912 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-664cfbae-92a8-48be-9f68-3e8222b4c625 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:02.726284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-664cfbae-92a8-48be-9f68-3e8222b4c625 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:02.740671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-664cfbae-92a8-48be-9f68-3e8222b4c625 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.197917 Aug 04 14:03:02.742535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 509/992] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:02 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:02.909624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cf58541b-ea52-4f8c-bbe3-41e5f131a00b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:02.910740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cf58541b-ea52-4f8c-bbe3-41e5f131a00b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:02.920614 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cf58541b-ea52-4f8c-bbe3-41e5f131a00b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:02.920972 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cf58541b-ea52-4f8c-bbe3-41e5f131a00b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:02.921763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cf58541b-ea52-4f8c-bbe3-41e5f131a00b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:02.922194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cf58541b-ea52-4f8c-bbe3-41e5f131a00b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:02.986868 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cf58541b-ea52-4f8c-bbe3-41e5f131a00b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.001613 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cf58541b-ea52-4f8c-bbe3-41e5f131a00b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.097462 Aug 04 14:03:03.002709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 484/993] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:02 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:03.094662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1578e5a7-b1cc-41b3-8ab3-65012b9c4010 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:03.095923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1578e5a7-b1cc-41b3-8ab3-65012b9c4010 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:03.102778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1578e5a7-b1cc-41b3-8ab3-65012b9c4010 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:03.103869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1578e5a7-b1cc-41b3-8ab3-65012b9c4010 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:03.104716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1578e5a7-b1cc-41b3-8ab3-65012b9c4010 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:03.105150 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1578e5a7-b1cc-41b3-8ab3-65012b9c4010 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:03.189873 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1578e5a7-b1cc-41b3-8ab3-65012b9c4010 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.204289 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1578e5a7-b1cc-41b3-8ab3-65012b9c4010 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.113457 Aug 04 14:03:03.205326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 510/994] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:03 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:03.470604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:03.471595 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:03.481272 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:03.482049 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:03.483455 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:03.484264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:03.669375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.679791 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.682310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.684110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-751b7a30-7779-4409-a6ea-66c91780b1be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.219944 Aug 04 14:03:03.685582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 485/995] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:03 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:03.761658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-00c696a2-217a-4536-b126-49660629f42a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:03.762468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-00c696a2-217a-4536-b126-49660629f42a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:03.769871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00c696a2-217a-4536-b126-49660629f42a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:03.770401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00c696a2-217a-4536-b126-49660629f42a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:03.771392 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00c696a2-217a-4536-b126-49660629f42a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:03.772346 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00c696a2-217a-4536-b126-49660629f42a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:03.944843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-00c696a2-217a-4536-b126-49660629f42a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.954371 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-00c696a2-217a-4536-b126-49660629f42a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.198159 Aug 04 14:03:03.955252 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 511/996] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:03 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:04.022370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e6ad1b22-c74f-4b93-b181-3f5a09e507ab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:04.023083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e6ad1b22-c74f-4b93-b181-3f5a09e507ab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:04.030462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6ad1b22-c74f-4b93-b181-3f5a09e507ab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:04.030976 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6ad1b22-c74f-4b93-b181-3f5a09e507ab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:04.031818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6ad1b22-c74f-4b93-b181-3f5a09e507ab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:04.032424 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e6ad1b22-c74f-4b93-b181-3f5a09e507ab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:04.101575 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e6ad1b22-c74f-4b93-b181-3f5a09e507ab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:04.110379 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e6ad1b22-c74f-4b93-b181-3f5a09e507ab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.091910 Aug 04 14:03:04.111124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 486/997] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:04 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:04.223240 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-619f0ff3-c241-4043-a7cb-fa837f0b3057 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:04.223940 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-619f0ff3-c241-4043-a7cb-fa837f0b3057 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:04.234655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-619f0ff3-c241-4043-a7cb-fa837f0b3057 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:04.235423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-619f0ff3-c241-4043-a7cb-fa837f0b3057 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:04.236853 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-619f0ff3-c241-4043-a7cb-fa837f0b3057 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:04.237618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-619f0ff3-c241-4043-a7cb-fa837f0b3057 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:04.332178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-619f0ff3-c241-4043-a7cb-fa837f0b3057 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:04.346301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-619f0ff3-c241-4043-a7cb-fa837f0b3057 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.126971 Aug 04 14:03:04.347775 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 512/998] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:04 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:04.714346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:04.715317 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:04.721887 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:04.722340 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:04.723165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:04.723595 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:04.867819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:04.877975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:04.879467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:04.880633 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6bac68c4-f173-4a1e-916d-7693abf14c5e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.170228 Aug 04 14:03:04.881211 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 487/999] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:04 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:04.974094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c505d599-aab4-4b85-acbb-0d5591b53fa1 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:04.974742 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c505d599-aab4-4b85-acbb-0d5591b53fa1 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:04.981404 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c505d599-aab4-4b85-acbb-0d5591b53fa1 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:04.981840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c505d599-aab4-4b85-acbb-0d5591b53fa1 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:04.982614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c505d599-aab4-4b85-acbb-0d5591b53fa1 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:04.983036 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c505d599-aab4-4b85-acbb-0d5591b53fa1 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:05.128776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-67c5fe0c-1dad-4cfb-9247-5b41f809cd26 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:05.129490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-67c5fe0c-1dad-4cfb-9247-5b41f809cd26 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:05.135934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67c5fe0c-1dad-4cfb-9247-5b41f809cd26 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:05.136506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67c5fe0c-1dad-4cfb-9247-5b41f809cd26 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:05.137341 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67c5fe0c-1dad-4cfb-9247-5b41f809cd26 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:05.137772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67c5fe0c-1dad-4cfb-9247-5b41f809cd26 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:05.145578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c505d599-aab4-4b85-acbb-0d5591b53fa1 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:05.154336 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c505d599-aab4-4b85-acbb-0d5591b53fa1 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.183971 Aug 04 14:03:05.154926 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 513/1000] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:04 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:05.208828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-67c5fe0c-1dad-4cfb-9247-5b41f809cd26 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:05.226067 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-67c5fe0c-1dad-4cfb-9247-5b41f809cd26 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.098936 Aug 04 14:03:05.235977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 488/1001] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:05 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:05.367268 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-155b19bc-25df-46f4-bf80-e8d061e14c8c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:05.368160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-155b19bc-25df-46f4-bf80-e8d061e14c8c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:05.377567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-155b19bc-25df-46f4-bf80-e8d061e14c8c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:05.378256 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-155b19bc-25df-46f4-bf80-e8d061e14c8c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:05.379092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-155b19bc-25df-46f4-bf80-e8d061e14c8c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:05.379744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-155b19bc-25df-46f4-bf80-e8d061e14c8c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:05.477419 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-155b19bc-25df-46f4-bf80-e8d061e14c8c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:05.495122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-155b19bc-25df-46f4-bf80-e8d061e14c8c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.132910 Aug 04 14:03:05.496408 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 514/1002] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:05 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:05.900672 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:05.901578 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:05.909041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:05.909489 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:05.910354 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:05.910787 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:06.075317 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.085992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.088636 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.089978 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-aa96cd95-50cb-4edd-afc6-ff8ceaca7705 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.194693 Aug 04 14:03:06.090781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 489/1003] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:05 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:06.184090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-31e13e06-cecd-4a56-99be-a5efec51376f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:06.185057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-31e13e06-cecd-4a56-99be-a5efec51376f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:06.191872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31e13e06-cecd-4a56-99be-a5efec51376f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:06.192345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31e13e06-cecd-4a56-99be-a5efec51376f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:06.193121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31e13e06-cecd-4a56-99be-a5efec51376f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:06.193544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-31e13e06-cecd-4a56-99be-a5efec51376f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:06.250632 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8f87d1da-ba30-4c25-81b7-41afec3736cb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:06.251328 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8f87d1da-ba30-4c25-81b7-41afec3736cb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:06.257283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8f87d1da-ba30-4c25-81b7-41afec3736cb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:06.257731 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8f87d1da-ba30-4c25-81b7-41afec3736cb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:06.258518 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8f87d1da-ba30-4c25-81b7-41afec3736cb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:06.259119 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8f87d1da-ba30-4c25-81b7-41afec3736cb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:06.335940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8f87d1da-ba30-4c25-81b7-41afec3736cb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.347107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-31e13e06-cecd-4a56-99be-a5efec51376f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.348622 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8f87d1da-ba30-4c25-81b7-41afec3736cb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.101521 Aug 04 14:03:06.349229 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 490/1004] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:06 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:06.355374 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-31e13e06-cecd-4a56-99be-a5efec51376f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.176527 Aug 04 14:03:06.355952 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 515/1005] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:06 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:06.513479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ddb8a515-0651-4ea6-8619-8f626a195a3e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:06.514097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ddb8a515-0651-4ea6-8619-8f626a195a3e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:06.520035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ddb8a515-0651-4ea6-8619-8f626a195a3e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:06.520532 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ddb8a515-0651-4ea6-8619-8f626a195a3e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:06.521314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ddb8a515-0651-4ea6-8619-8f626a195a3e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:06.521754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ddb8a515-0651-4ea6-8619-8f626a195a3e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:06.590105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ddb8a515-0651-4ea6-8619-8f626a195a3e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.598941 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ddb8a515-0651-4ea6-8619-8f626a195a3e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.090154 Aug 04 14:03:06.599560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 491/1006] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:06 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:07.113014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:07.115220 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:07.123733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:07.124366 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:07.125246 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:07.125688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:07.298192 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:07.312661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:07.315236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:07.317348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-af7217d2-e482-447b-934f-641d12cba520 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.210961 Aug 04 14:03:07.318209 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 516/1007] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:07 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:07.368528 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6a39391a-29ca-47bb-8a0e-d0e08da8c08e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:07.372042 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6a39391a-29ca-47bb-8a0e-d0e08da8c08e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:07.372930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-eee0e5c0-3e7e-4ff7-b5d1-c6677812c244 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:07.373584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-eee0e5c0-3e7e-4ff7-b5d1-c6677812c244 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:07.380324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eee0e5c0-3e7e-4ff7-b5d1-c6677812c244 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:07.380687 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eee0e5c0-3e7e-4ff7-b5d1-c6677812c244 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:07.381479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eee0e5c0-3e7e-4ff7-b5d1-c6677812c244 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:07.381914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eee0e5c0-3e7e-4ff7-b5d1-c6677812c244 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:07.383618 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6a39391a-29ca-47bb-8a0e-d0e08da8c08e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:07.385194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6a39391a-29ca-47bb-8a0e-d0e08da8c08e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:07.387075 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6a39391a-29ca-47bb-8a0e-d0e08da8c08e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:07.388032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6a39391a-29ca-47bb-8a0e-d0e08da8c08e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:07.479041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6a39391a-29ca-47bb-8a0e-d0e08da8c08e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:07.487326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6a39391a-29ca-47bb-8a0e-d0e08da8c08e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.124563 Aug 04 14:03:07.487924 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 492/1008] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:07 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:07.542046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-eee0e5c0-3e7e-4ff7-b5d1-c6677812c244 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:07.558735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-eee0e5c0-3e7e-4ff7-b5d1-c6677812c244 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.189697 Aug 04 14:03:07.559715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 517/1009] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:07 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:07.616940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3a66f6eb-6ea1-48df-87b9-bd87e2fe2b58 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:07.617783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3a66f6eb-6ea1-48df-87b9-bd87e2fe2b58 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:07.631362 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3a66f6eb-6ea1-48df-87b9-bd87e2fe2b58 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:07.632011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3a66f6eb-6ea1-48df-87b9-bd87e2fe2b58 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:07.633258 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3a66f6eb-6ea1-48df-87b9-bd87e2fe2b58 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:07.633887 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3a66f6eb-6ea1-48df-87b9-bd87e2fe2b58 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:07.701642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3a66f6eb-6ea1-48df-87b9-bd87e2fe2b58 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:07.709425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3a66f6eb-6ea1-48df-87b9-bd87e2fe2b58 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.096312 Aug 04 14:03:07.710026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 493/1010] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:07 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:08.351156 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.355106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:08.365795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:08.366593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:08.368398 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:08.369286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:08.513461 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-19510217-ec16-47f4-a655-abea8733aaab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.514724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-19510217-ec16-47f4-a655-abea8733aaab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:08.522231 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-19510217-ec16-47f4-a655-abea8733aaab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:08.522875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-19510217-ec16-47f4-a655-abea8733aaab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:08.523885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-19510217-ec16-47f4-a655-abea8733aaab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:08.524465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-19510217-ec16-47f4-a655-abea8733aaab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:08.537844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.555807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.557975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.559476 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-944d32a6-03ce-46fd-bc2b-23fae7fec129 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.215246 Aug 04 14:03:08.560628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 518/1011] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:08 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:03:08.586787 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6afffa19-68c7-46cc-8165-7109d736a7d8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.588724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6afffa19-68c7-46cc-8165-7109d736a7d8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:08.595606 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6afffa19-68c7-46cc-8165-7109d736a7d8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:08.596048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6afffa19-68c7-46cc-8165-7109d736a7d8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:08.597143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6afffa19-68c7-46cc-8165-7109d736a7d8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:08.597807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6afffa19-68c7-46cc-8165-7109d736a7d8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:08.607176 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-19510217-ec16-47f4-a655-abea8733aaab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.615220 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-19510217-ec16-47f4-a655-abea8733aaab tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.108067 Aug 04 14:03:08.615859 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 494/1012] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:08 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:08.733573 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d31c6d39-51a6-4a5c-8279-a7d9399b7a64 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.734760 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d31c6d39-51a6-4a5c-8279-a7d9399b7a64 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:08.751457 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d31c6d39-51a6-4a5c-8279-a7d9399b7a64 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:08.752400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d31c6d39-51a6-4a5c-8279-a7d9399b7a64 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:08.753550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d31c6d39-51a6-4a5c-8279-a7d9399b7a64 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:08.754243 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d31c6d39-51a6-4a5c-8279-a7d9399b7a64 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:08.761588 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6afffa19-68c7-46cc-8165-7109d736a7d8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.771820 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6afffa19-68c7-46cc-8165-7109d736a7d8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.188856 Aug 04 14:03:08.772672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 519/1013] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:08 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:08.819018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d31c6d39-51a6-4a5c-8279-a7d9399b7a64 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.831576 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d31c6d39-51a6-4a5c-8279-a7d9399b7a64 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.105956 Aug 04 14:03:08.832168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 495/1014] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:08 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:09.582788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:09.583957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:09.592621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:09.593073 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:09.594176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:09.594624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:09.632330 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0455f4fd-3ea0-419e-94b0-43ec95c95112 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:09.632965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0455f4fd-3ea0-419e-94b0-43ec95c95112 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:09.641086 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0455f4fd-3ea0-419e-94b0-43ec95c95112 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:09.641086 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0455f4fd-3ea0-419e-94b0-43ec95c95112 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:09.641585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0455f4fd-3ea0-419e-94b0-43ec95c95112 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:09.642170 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0455f4fd-3ea0-419e-94b0-43ec95c95112 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:09.720842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0455f4fd-3ea0-419e-94b0-43ec95c95112 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:09.728154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0455f4fd-3ea0-419e-94b0-43ec95c95112 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.099444 Aug 04 14:03:09.729543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 496/1015] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:09 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:09.760779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:09.770309 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:09.771965 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:09.773143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9cff8b4f-268d-457c-90c3-f72b08a71aa0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.197986 Aug 04 14:03:09.773700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 520/1016] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:09 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:09.791454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f84d8466-922b-41a2-b3d4-be93db54e578 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:09.792061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f84d8466-922b-41a2-b3d4-be93db54e578 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:09.800783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f84d8466-922b-41a2-b3d4-be93db54e578 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:09.801227 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f84d8466-922b-41a2-b3d4-be93db54e578 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:09.802018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f84d8466-922b-41a2-b3d4-be93db54e578 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:09.802441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f84d8466-922b-41a2-b3d4-be93db54e578 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:09.860166 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a2610d8c-fc0a-478f-975c-658a0382cb28 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:09.860166 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a2610d8c-fc0a-478f-975c-658a0382cb28 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:09.866219 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a2610d8c-fc0a-478f-975c-658a0382cb28 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:09.866680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a2610d8c-fc0a-478f-975c-658a0382cb28 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:09.867482 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a2610d8c-fc0a-478f-975c-658a0382cb28 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:09.867918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a2610d8c-fc0a-478f-975c-658a0382cb28 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:09.947117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a2610d8c-fc0a-478f-975c-658a0382cb28 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:09.960882 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a2610d8c-fc0a-478f-975c-658a0382cb28 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.111521 Aug 04 14:03:09.962186 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 521/1017] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:09 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:09.975817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f84d8466-922b-41a2-b3d4-be93db54e578 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:09.985414 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f84d8466-922b-41a2-b3d4-be93db54e578 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.197049 Aug 04 14:03:09.986538 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 497/1018] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:09 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:10.753301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7c1d05fa-769e-4394-8cdb-1d36f7d77add tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:10.753976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7c1d05fa-769e-4394-8cdb-1d36f7d77add tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:10.760247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c1d05fa-769e-4394-8cdb-1d36f7d77add tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:10.760720 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c1d05fa-769e-4394-8cdb-1d36f7d77add tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:10.761498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c1d05fa-769e-4394-8cdb-1d36f7d77add tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:10.761923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c1d05fa-769e-4394-8cdb-1d36f7d77add tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:10.797894 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:10.801697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:10.815238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:10.815910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:10.816686 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:10.817090 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:10.826689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7c1d05fa-769e-4394-8cdb-1d36f7d77add tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:10.834414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7c1d05fa-769e-4394-8cdb-1d36f7d77add tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.085058 Aug 04 14:03:10.834996 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 522/1019] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:10 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:10.959326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:10.968051 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:10.969550 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:10.970915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d107bf4f-d205-4349-944d-ba275809c86b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.181658 Aug 04 14:03:10.971308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 498/1020] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:10 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:10.985347 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-35fb18c8-e759-4887-92d7-9e2150b7319b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:10.985951 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-35fb18c8-e759-4887-92d7-9e2150b7319b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:10.992695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35fb18c8-e759-4887-92d7-9e2150b7319b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:10.993291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35fb18c8-e759-4887-92d7-9e2150b7319b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:10.995323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35fb18c8-e759-4887-92d7-9e2150b7319b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:10.996148 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35fb18c8-e759-4887-92d7-9e2150b7319b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:11.004017 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-feeb7119-1972-4498-8f6d-3ea5df1a18b8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:11.004574 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-feeb7119-1972-4498-8f6d-3ea5df1a18b8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:11.010392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feeb7119-1972-4498-8f6d-3ea5df1a18b8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:11.010855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feeb7119-1972-4498-8f6d-3ea5df1a18b8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:11.011612 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feeb7119-1972-4498-8f6d-3ea5df1a18b8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:11.012040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-feeb7119-1972-4498-8f6d-3ea5df1a18b8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:11.092484 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-35fb18c8-e759-4887-92d7-9e2150b7319b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:11.106396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-35fb18c8-e759-4887-92d7-9e2150b7319b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.121626 Aug 04 14:03:11.106396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 523/1021] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:10 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:11.225553 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-feeb7119-1972-4498-8f6d-3ea5df1a18b8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:11.234521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-feeb7119-1972-4498-8f6d-3ea5df1a18b8 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.234856 Aug 04 14:03:11.235156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 499/1022] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:10 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:11.851507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bc846424-02df-40c2-819a-3d54c13f26bb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:11.852063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bc846424-02df-40c2-819a-3d54c13f26bb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:11.858966 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc846424-02df-40c2-819a-3d54c13f26bb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:11.859394 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc846424-02df-40c2-819a-3d54c13f26bb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:11.860181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc846424-02df-40c2-819a-3d54c13f26bb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:11.860645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bc846424-02df-40c2-819a-3d54c13f26bb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:11.925126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bc846424-02df-40c2-819a-3d54c13f26bb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:11.932788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bc846424-02df-40c2-819a-3d54c13f26bb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.085163 Aug 04 14:03:11.933381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 524/1023] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:11 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:11.991215 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:11.992364 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:11.999536 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:11.999992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:12.000830 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:12.001272 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:12.123161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-64fdf87f-14b6-4dc4-b161-027bf56a752b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:12.123680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-64fdf87f-14b6-4dc4-b161-027bf56a752b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:12.129304 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-64fdf87f-14b6-4dc4-b161-027bf56a752b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:12.129745 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-64fdf87f-14b6-4dc4-b161-027bf56a752b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:12.130506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-64fdf87f-14b6-4dc4-b161-027bf56a752b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:12.130929 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-64fdf87f-14b6-4dc4-b161-027bf56a752b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:12.134967 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:12.143891 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:12.145438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:12.146584 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b170da96-492a-42bf-901f-575b81cccb08 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.160229 Aug 04 14:03:12.147149 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 500/1024] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:11 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:12.202109 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-64fdf87f-14b6-4dc4-b161-027bf56a752b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:12.213016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-64fdf87f-14b6-4dc4-b161-027bf56a752b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.093299 Aug 04 14:03:12.213788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 525/1025] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:12 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:12.250732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-95e2b87b-b66b-4e7c-860b-23a299475464 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:12.251367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-95e2b87b-b66b-4e7c-860b-23a299475464 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:12.257523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-95e2b87b-b66b-4e7c-860b-23a299475464 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:12.257971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-95e2b87b-b66b-4e7c-860b-23a299475464 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:12.258818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-95e2b87b-b66b-4e7c-860b-23a299475464 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:12.260015 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-95e2b87b-b66b-4e7c-860b-23a299475464 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:12.389918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-95e2b87b-b66b-4e7c-860b-23a299475464 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:12.399092 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-95e2b87b-b66b-4e7c-860b-23a299475464 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.151916 Aug 04 14:03:12.402010 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 501/1026] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:12 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:12.958189 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ee1001b8-8bd9-480a-86dd-3f87f68cf273 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:12.961214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ee1001b8-8bd9-480a-86dd-3f87f68cf273 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:12.975802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee1001b8-8bd9-480a-86dd-3f87f68cf273 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:12.976899 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee1001b8-8bd9-480a-86dd-3f87f68cf273 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:12.978692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee1001b8-8bd9-480a-86dd-3f87f68cf273 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:12.979483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ee1001b8-8bd9-480a-86dd-3f87f68cf273 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:13.093702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ee1001b8-8bd9-480a-86dd-3f87f68cf273 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:13.101515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ee1001b8-8bd9-480a-86dd-3f87f68cf273 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.152239 Aug 04 14:03:13.102073 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 526/1027] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:12 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:13.171641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3a3344-7933-4f44-b101-0fa2c3ed818a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 14:03:13.174876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:13.175472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:13.182931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:13.183638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:13.184818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:13.185491 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:13.232300 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1e9cc88d-4e21-4ea0-8016-50425b636735 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:13.233343 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1e9cc88d-4e21-4ea0-8016-50425b636735 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:13.252112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e9cc88d-4e21-4ea0-8016-50425b636735 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:13.252690 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e9cc88d-4e21-4ea0-8016-50425b636735 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:13.253539 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e9cc88d-4e21-4ea0-8016-50425b636735 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:13.254040 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e9cc88d-4e21-4ea0-8016-50425b636735 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:13.332120 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1e9cc88d-4e21-4ea0-8016-50425b636735 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:13.339752 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1e9cc88d-4e21-4ea0-8016-50425b636735 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.112504 Aug 04 14:03:13.340607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 527/1028] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:13 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:13.346352 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:13.355248 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:13.356766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:13.357888 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-71a7769b-88c2-4461-9280-26ab92f55ea8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.187967 Aug 04 14:03:13.358450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 502/1029] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:13 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:13.416952 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a41f0bd1-f220-48e9-a6b0-4b20237247a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:13.417692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a41f0bd1-f220-48e9-a6b0-4b20237247a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:13.423977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a41f0bd1-f220-48e9-a6b0-4b20237247a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:13.424469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a41f0bd1-f220-48e9-a6b0-4b20237247a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:13.425339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a41f0bd1-f220-48e9-a6b0-4b20237247a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:13.425856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a41f0bd1-f220-48e9-a6b0-4b20237247a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:13.569630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a41f0bd1-f220-48e9-a6b0-4b20237247a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:13.577749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a41f0bd1-f220-48e9-a6b0-4b20237247a4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.165468 Aug 04 14:03:13.578536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 528/1030] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:13 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:14.117856 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e01e5b23-a4ef-4abd-ba21-823b6039ff9e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:14.118973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e01e5b23-a4ef-4abd-ba21-823b6039ff9e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:14.125007 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e01e5b23-a4ef-4abd-ba21-823b6039ff9e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:14.125459 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e01e5b23-a4ef-4abd-ba21-823b6039ff9e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:14.126240 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e01e5b23-a4ef-4abd-ba21-823b6039ff9e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:14.126678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e01e5b23-a4ef-4abd-ba21-823b6039ff9e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:14.190285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e01e5b23-a4ef-4abd-ba21-823b6039ff9e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:14.197727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3a3344-7933-4f44-b101-0fa2c3ed818a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 36580. Aug 04 14:03:14.200585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e01e5b23-a4ef-4abd-ba21-823b6039ff9e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.086458 Aug 04 14:03:14.201356 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 503/1031] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:14 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:14.356198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dc02db94-d693-46f9-8f5b-0d05dd90d1b5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:14.356808 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-dc02db94-d693-46f9-8f5b-0d05dd90d1b5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:14.362583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dc02db94-d693-46f9-8f5b-0d05dd90d1b5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:14.363028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dc02db94-d693-46f9-8f5b-0d05dd90d1b5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:14.363813 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dc02db94-d693-46f9-8f5b-0d05dd90d1b5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:14.364241 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dc02db94-d693-46f9-8f5b-0d05dd90d1b5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:14.375716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:14.376408 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:14.382384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:14.382948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:14.383745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:14.385060 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:14.432010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dc02db94-d693-46f9-8f5b-0d05dd90d1b5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:14.439289 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-dc02db94-d693-46f9-8f5b-0d05dd90d1b5 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.086987 Aug 04 14:03:14.439943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 529/1032] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:14 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:14.508842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:14.517228 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:14.518723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:14.519856 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-00f81f5d-00f1-45ec-9dec-1d4cf4154293 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.148392 Aug 04 14:03:14.520459 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 504/1033] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:14 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:03:14.595827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-94f27a8d-13dc-4d72-9a79-0ae2d791418f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:14.596472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-94f27a8d-13dc-4d72-9a79-0ae2d791418f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:14.602197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-94f27a8d-13dc-4d72-9a79-0ae2d791418f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:14.602644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-94f27a8d-13dc-4d72-9a79-0ae2d791418f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:14.604102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-94f27a8d-13dc-4d72-9a79-0ae2d791418f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:14.604569 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-94f27a8d-13dc-4d72-9a79-0ae2d791418f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:14.724841 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-94f27a8d-13dc-4d72-9a79-0ae2d791418f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:14.732810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-94f27a8d-13dc-4d72-9a79-0ae2d791418f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.140659 Aug 04 14:03:14.733372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 530/1034] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:14 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:15.218181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-45afdbd7-ebf6-44cf-a03a-a171eec09b61 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:15.218804 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-45afdbd7-ebf6-44cf-a03a-a171eec09b61 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:15.224764 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45afdbd7-ebf6-44cf-a03a-a171eec09b61 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:15.225215 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45afdbd7-ebf6-44cf-a03a-a171eec09b61 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:15.225984 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45afdbd7-ebf6-44cf-a03a-a171eec09b61 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:15.226414 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45afdbd7-ebf6-44cf-a03a-a171eec09b61 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:15.289156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-45afdbd7-ebf6-44cf-a03a-a171eec09b61 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.296773 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-45afdbd7-ebf6-44cf-a03a-a171eec09b61 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.082283 Aug 04 14:03:15.297344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 505/1035] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:15 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:15.456029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-eb71290a-f491-4ce3-9199-99777534d75b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:15.456669 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-eb71290a-f491-4ce3-9199-99777534d75b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:15.466077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eb71290a-f491-4ce3-9199-99777534d75b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:15.466541 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eb71290a-f491-4ce3-9199-99777534d75b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:15.467332 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eb71290a-f491-4ce3-9199-99777534d75b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:15.467766 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eb71290a-f491-4ce3-9199-99777534d75b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:15.529540 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-eb71290a-f491-4ce3-9199-99777534d75b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.536807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-eb71290a-f491-4ce3-9199-99777534d75b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.084431 Aug 04 14:03:15.537379 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 531/1036] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:15 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:15.538556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:15.539279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:15.545579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:15.546117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:15.546959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:15.547396 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:15.668898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.676998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.678484 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.679600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a223b492-17f6-4e4e-9cc5-ebdaec794737 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.144931 Aug 04 14:03:15.680157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 506/1037] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:15 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:03:15.749826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6a357808-2341-4b36-8abb-e05ca823a1bf tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:15.750423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6a357808-2341-4b36-8abb-e05ca823a1bf tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:15.756145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a357808-2341-4b36-8abb-e05ca823a1bf tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:15.756684 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a357808-2341-4b36-8abb-e05ca823a1bf tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:15.757437 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a357808-2341-4b36-8abb-e05ca823a1bf tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:15.757860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a357808-2341-4b36-8abb-e05ca823a1bf tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:15.893368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6a357808-2341-4b36-8abb-e05ca823a1bf tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.901874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6a357808-2341-4b36-8abb-e05ca823a1bf tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.155565 Aug 04 14:03:15.902486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 532/1038] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:15 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:16.313676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-38d8fd17-1653-43e2-84ca-ded66a5d76dc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:16.314273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-38d8fd17-1653-43e2-84ca-ded66a5d76dc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:16.320105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38d8fd17-1653-43e2-84ca-ded66a5d76dc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:16.320574 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38d8fd17-1653-43e2-84ca-ded66a5d76dc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:16.321327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38d8fd17-1653-43e2-84ca-ded66a5d76dc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:16.322466 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38d8fd17-1653-43e2-84ca-ded66a5d76dc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:16.381970 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-38d8fd17-1653-43e2-84ca-ded66a5d76dc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.390196 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-38d8fd17-1653-43e2-84ca-ded66a5d76dc tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.080146 Aug 04 14:03:16.390858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 507/1039] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:16 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:16.554049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3f81df52-6ddf-4f41-856b-a0d851cefc3c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:16.554647 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3f81df52-6ddf-4f41-856b-a0d851cefc3c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:16.561697 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f81df52-6ddf-4f41-856b-a0d851cefc3c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:16.562132 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f81df52-6ddf-4f41-856b-a0d851cefc3c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:16.562889 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f81df52-6ddf-4f41-856b-a0d851cefc3c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:16.563320 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f81df52-6ddf-4f41-856b-a0d851cefc3c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:16.625335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3f81df52-6ddf-4f41-856b-a0d851cefc3c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.632659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3f81df52-6ddf-4f41-856b-a0d851cefc3c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.082240 Aug 04 14:03:16.633217 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 533/1040] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:16 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:16.697635 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:16.698511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:16.704466 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:16.704925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:16.705700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:16.706134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:16.832884 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.841231 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.842726 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.843866 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1ae2b841-8892-4c8f-b058-f35fd40a7cc0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.150078 Aug 04 14:03:16.844458 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 508/1041] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:16 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:16.919892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-884cc144-34c0-4528-8149-bc5004f0bc2c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:16.920523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-884cc144-34c0-4528-8149-bc5004f0bc2c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:16.926261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-884cc144-34c0-4528-8149-bc5004f0bc2c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:16.926703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-884cc144-34c0-4528-8149-bc5004f0bc2c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:16.927461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-884cc144-34c0-4528-8149-bc5004f0bc2c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:16.927891 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-884cc144-34c0-4528-8149-bc5004f0bc2c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:17.062174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-884cc144-34c0-4528-8149-bc5004f0bc2c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:17.070395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-884cc144-34c0-4528-8149-bc5004f0bc2c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.155515 Aug 04 14:03:17.070978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 534/1042] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:16 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:17.406913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2b85417f-7e28-4b7a-bf95-697beef483a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:17.407523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2b85417f-7e28-4b7a-bf95-697beef483a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:17.415308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2b85417f-7e28-4b7a-bf95-697beef483a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:17.416341 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2b85417f-7e28-4b7a-bf95-697beef483a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:17.417893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2b85417f-7e28-4b7a-bf95-697beef483a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:17.418917 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2b85417f-7e28-4b7a-bf95-697beef483a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:17.486080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2b85417f-7e28-4b7a-bf95-697beef483a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:17.494097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2b85417f-7e28-4b7a-bf95-697beef483a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.090858 Aug 04 14:03:17.494876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 509/1043] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:17 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:17.651469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1c813381-2f70-40bc-88ba-9bd9f4e5bc1d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:17.652084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1c813381-2f70-40bc-88ba-9bd9f4e5bc1d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:17.662584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c813381-2f70-40bc-88ba-9bd9f4e5bc1d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:17.663191 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c813381-2f70-40bc-88ba-9bd9f4e5bc1d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:17.664334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c813381-2f70-40bc-88ba-9bd9f4e5bc1d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:17.664856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c813381-2f70-40bc-88ba-9bd9f4e5bc1d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:17.733762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1c813381-2f70-40bc-88ba-9bd9f4e5bc1d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:17.741828 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1c813381-2f70-40bc-88ba-9bd9f4e5bc1d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.094893 Aug 04 14:03:17.742478 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 535/1044] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:17 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:17.861998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:17.862596 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:17.869483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:17.869678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:17.870436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:17.870863 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:18.008261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:18.018902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:18.020430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:18.021644 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1e0c7560-53a5-4ce3-957d-ea548d9d623c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.163320 Aug 04 14:03:18.022158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 510/1045] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:17 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:18.087417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7e7645d7-1fd8-4ea8-b17e-be87138bb365 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:18.088359 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7e7645d7-1fd8-4ea8-b17e-be87138bb365 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:18.094598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e7645d7-1fd8-4ea8-b17e-be87138bb365 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:18.095047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e7645d7-1fd8-4ea8-b17e-be87138bb365 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:18.095904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e7645d7-1fd8-4ea8-b17e-be87138bb365 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:18.096370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7e7645d7-1fd8-4ea8-b17e-be87138bb365 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:18.224083 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7e7645d7-1fd8-4ea8-b17e-be87138bb365 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:18.231936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7e7645d7-1fd8-4ea8-b17e-be87138bb365 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.148179 Aug 04 14:03:18.232543 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 536/1046] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:18 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:18.511434 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f9c3642f-fcc8-4c18-8c64-a06f38905dcb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:18.512014 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f9c3642f-fcc8-4c18-8c64-a06f38905dcb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:18.517979 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f9c3642f-fcc8-4c18-8c64-a06f38905dcb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:18.518420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f9c3642f-fcc8-4c18-8c64-a06f38905dcb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:18.519241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f9c3642f-fcc8-4c18-8c64-a06f38905dcb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:18.519616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f9c3642f-fcc8-4c18-8c64-a06f38905dcb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:18.590197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f9c3642f-fcc8-4c18-8c64-a06f38905dcb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:18.598402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f9c3642f-fcc8-4c18-8c64-a06f38905dcb tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1225 microversion: 2.1 time: 0.091073 Aug 04 14:03:18.599019 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 511/1047] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:18 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:18.760311 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a1d74a32-ea04-4a21-a8c2-8e192302deea tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:18.761085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a1d74a32-ea04-4a21-a8c2-8e192302deea tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:18.767640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a1d74a32-ea04-4a21-a8c2-8e192302deea tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:18.768168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a1d74a32-ea04-4a21-a8c2-8e192302deea tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:18.769316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a1d74a32-ea04-4a21-a8c2-8e192302deea tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:18.769828 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a1d74a32-ea04-4a21-a8c2-8e192302deea tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:18.835077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a1d74a32-ea04-4a21-a8c2-8e192302deea tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:18.844605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a1d74a32-ea04-4a21-a8c2-8e192302deea tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1223 microversion: 2.1 time: 0.088587 Aug 04 14:03:18.845255 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 537/1048] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:18 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:19.042724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:19.043504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:19.053154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.053898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.054932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.055438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.192669 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.202207 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.203686 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.204889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d245274e-5b2a-476c-a7ed-9d3ebbbbfbeb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.168379 Aug 04 14:03:19.205509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 512/1049] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:19 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:03:19.249358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-42232a2e-a450-4f30-9734-92dd83deadba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:19.249960 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-42232a2e-a450-4f30-9734-92dd83deadba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:19.255823 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42232a2e-a450-4f30-9734-92dd83deadba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.256290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42232a2e-a450-4f30-9734-92dd83deadba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.257053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42232a2e-a450-4f30-9734-92dd83deadba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.257478 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42232a2e-a450-4f30-9734-92dd83deadba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.401998 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-42232a2e-a450-4f30-9734-92dd83deadba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.410549 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-42232a2e-a450-4f30-9734-92dd83deadba tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.164728 Aug 04 14:03:19.411198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 538/1050] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:19 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:19.615865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:19.616663 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:19.623421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.623861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.624658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.625083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.658027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.658460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.658901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lazy-loading 'fault' on Instance uuid f674980e-9f84-4659-bbd4-114786775944 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:03:19.699376 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.706727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9ebf4967-4896-4845-a016-aec359aeb1d2 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1230 microversion: 2.1 time: 0.094872 Aug 04 14:03:19.707304 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 513/1051] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:19 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:19.862747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3150ea93-b0b2-47ba-a96c-210d2343ae4e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:19.863408 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3150ea93-b0b2-47ba-a96c-210d2343ae4e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:19.869632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3150ea93-b0b2-47ba-a96c-210d2343ae4e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.870076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3150ea93-b0b2-47ba-a96c-210d2343ae4e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.870917 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3150ea93-b0b2-47ba-a96c-210d2343ae4e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:19.871353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3150ea93-b0b2-47ba-a96c-210d2343ae4e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:19.934659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3150ea93-b0b2-47ba-a96c-210d2343ae4e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.942589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3150ea93-b0b2-47ba-a96c-210d2343ae4e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1215 microversion: 2.1 time: 0.083849 Aug 04 14:03:19.943184 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 539/1052] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:19 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:20.228849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:20.230354 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:20.241311 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.242116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:20.243627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.244440 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:20.417043 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:20.434942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-069003cf-3772-423e-afa6-e3f35114d848 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:20.435293 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:20.436262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-069003cf-3772-423e-afa6-e3f35114d848 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:20.437442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:20.438819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-660d6aca-078e-4d90-8965-1df2caf50ebc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.216857 Aug 04 14:03:20.439742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 514/1053] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:20 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:20.448298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-069003cf-3772-423e-afa6-e3f35114d848 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.449196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-069003cf-3772-423e-afa6-e3f35114d848 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:20.450529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-069003cf-3772-423e-afa6-e3f35114d848 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.451241 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-069003cf-3772-423e-afa6-e3f35114d848 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:20.699194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-069003cf-3772-423e-afa6-e3f35114d848 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:20.707104 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-069003cf-3772-423e-afa6-e3f35114d848 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.282464 Aug 04 14:03:20.707901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 540/1054] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:20 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:20.726462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:20.728251 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:20.739867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.741152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:20.744812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.747936 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:20.785895 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.786675 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:20.787208 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lazy-loading 'fault' on Instance uuid f674980e-9f84-4659-bbd4-114786775944 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:03:20.842179 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:20.850916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1984d525-86e8-4405-bed0-e893e461ec75 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1230 microversion: 2.1 time: 0.128356 Aug 04 14:03:20.851695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 515/1055] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:20 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1230 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:20.961328 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-011c8dcc-dffe-4f11-a43c-cdd1f819defe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:20.961934 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-011c8dcc-dffe-4f11-a43c-cdd1f819defe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:20.967633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-011c8dcc-dffe-4f11-a43c-cdd1f819defe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.968078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-011c8dcc-dffe-4f11-a43c-cdd1f819defe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:20.968895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-011c8dcc-dffe-4f11-a43c-cdd1f819defe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:20.969338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-011c8dcc-dffe-4f11-a43c-cdd1f819defe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:21.032777 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-011c8dcc-dffe-4f11-a43c-cdd1f819defe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.047810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-011c8dcc-dffe-4f11-a43c-cdd1f819defe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1277 microversion: 2.1 time: 0.090386 Aug 04 14:03:21.048734 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 541/1056] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:20 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:21.467229 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:21.467861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:21.474481 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:21.474931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:21.475781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:21.476253 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:21.724798 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-36148a00-3b73-4c47-9a06-9dabf11b0a3c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:21.725298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-36148a00-3b73-4c47-9a06-9dabf11b0a3c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:21.733293 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.741809 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-36148a00-3b73-4c47-9a06-9dabf11b0a3c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:21.742114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.742297 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-36148a00-3b73-4c47-9a06-9dabf11b0a3c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:21.744259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-36148a00-3b73-4c47-9a06-9dabf11b0a3c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:21.744450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.744644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-36148a00-3b73-4c47-9a06-9dabf11b0a3c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:21.744808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-02e2069e-3982-4cf1-9a98-b0b9fcdb56c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.281379 Aug 04 14:03:21.755765 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 516/1057] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:21 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:21.869247 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:21.870521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:21.877254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:21.878885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:21.879747 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:21.880413 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:21.927235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:21.929185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:21.929914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lazy-loading 'fault' on Instance uuid f674980e-9f84-4659-bbd4-114786775944 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:03:21.950976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-36148a00-3b73-4c47-9a06-9dabf11b0a3c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.963942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-36148a00-3b73-4c47-9a06-9dabf11b0a3c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.241341 Aug 04 14:03:21.974951 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 542/1058] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:21 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:22.033653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.050923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-73e79f9e-1d67-4717-9bb2-8475c8285fe0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 200 len: 1184 microversion: 2.1 time: 0.186516 Aug 04 14:03:22.052069 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 517/1059] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:21 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 1184 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:22.066728 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2e020680-117e-435a-a847-1d19af6546a0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:22.067437 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2e020680-117e-435a-a847-1d19af6546a0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:22.074254 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e020680-117e-435a-a847-1d19af6546a0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:22.074705 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e020680-117e-435a-a847-1d19af6546a0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:22.075486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e020680-117e-435a-a847-1d19af6546a0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:22.075914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e020680-117e-435a-a847-1d19af6546a0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:22.206175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2e020680-117e-435a-a847-1d19af6546a0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.213896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2e020680-117e-435a-a847-1d19af6546a0 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.151168 Aug 04 14:03:22.214458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 543/1060] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:22 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:22.287094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-e594e430-8021-4cd4-8246-d0a9445ce25f req-4e0f09a7-4bc6-4a3e-8483-aa70b66c1baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b05f2a-726a-417c-bdd9-6cedfd3d1980", "tag": "30375858-efad-4eb7-b5a3-c35704e441ff"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:22.288698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:22.288698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:03:22.295413 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-e594e430-8021-4cd4-8246-d0a9445ce25f req-4e0f09a7-4bc6-4a3e-8483-aa70b66c1baa service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:22.295858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-e594e430-8021-4cd4-8246-d0a9445ce25f req-4e0f09a7-4bc6-4a3e-8483-aa70b66c1baa service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:22.307289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-e594e430-8021-4cd4-8246-d0a9445ce25f req-4e0f09a7-4bc6-4a3e-8483-aa70b66c1baa service nova] Creating event network-changed:30375858-efad-4eb7-b5a3-c35704e441ff for instance d4b05f2a-726a-417c-bdd9-6cedfd3d1980 on hv-cinder-79264 Aug 04 14:03:22.311996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-e594e430-8021-4cd4-8246-d0a9445ce25f req-4e0f09a7-4bc6-4a3e-8483-aa70b66c1baa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028618 Aug 04 14:03:22.312714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 518/1061] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:22.762920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:22.763571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:22.770496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:22.770953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:22.771744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:22.772185 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:22.929707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.939527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.941071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.942323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-33300bd1-2c48-407d-aa94-828616644f4e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.183250 Aug 04 14:03:22.942800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 544/1062] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:22 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:22.984356 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-052157f3-4282-4966-a349-3716fa47df58 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:22.985060 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-052157f3-4282-4966-a349-3716fa47df58 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:22.991656 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-052157f3-4282-4966-a349-3716fa47df58 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:22.992122 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-052157f3-4282-4966-a349-3716fa47df58 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:22.992923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-052157f3-4282-4966-a349-3716fa47df58 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:22.993944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-052157f3-4282-4966-a349-3716fa47df58 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:23.069299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:23.069986 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:23.076972 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:23.077458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:23.078228 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:23.078659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:23.094258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] HTTP exception thrown: Instance f674980e-9f84-4659-bbd4-114786775944 could not be found. Aug 04 14:03:23.094870 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Returning 404 to user: Instance f674980e-9f84-4659-bbd4-114786775944 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:03:23.095718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e5a0bda8-c2f1-4f34-8e90-b58f52d9b2e4 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 404 len: 111 microversion: 2.1 time: 0.030723 Aug 04 14:03:23.096308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 545/1063] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:23 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:03:23.150033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1253424656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866386038", "security_groups": [{"name": "tempest-secgroup-smoke-1201868746"}], "block_device_mapping_v2": [{"uuid": "884c3a77-016e-4238-9ecc-89df41e308ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77be53e2-6c8e-4582-aec6-d3baff66b203"}]}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:23.278335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] validate_networks() for [('77be53e2-6c8e-4582-aec6-d3baff66b203', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:03:23.375374 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-052157f3-4282-4966-a349-3716fa47df58 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:23.384489 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-052157f3-4282-4966-a349-3716fa47df58 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.403640 Aug 04 14:03:23.385222 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 519/1064] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:22 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:23.390790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1159db36-b9e6-4fd6-a48a-16d825341128 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:23.392013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1159db36-b9e6-4fd6-a48a-16d825341128 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:23.400567 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1159db36-b9e6-4fd6-a48a-16d825341128 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:23.401089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1159db36-b9e6-4fd6-a48a-16d825341128 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:23.402089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1159db36-b9e6-4fd6-a48a-16d825341128 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:23.402745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1159db36-b9e6-4fd6-a48a-16d825341128 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:23.636173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1159db36-b9e6-4fd6-a48a-16d825341128 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:23.648127 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1159db36-b9e6-4fd6-a48a-16d825341128 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.259916 Aug 04 14:03:23.650998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 520/1065] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:23 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:23.800505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:03:23.800867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:03:23.801547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:03:23.801742 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:03:23.802139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:03:23.812666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:23.813110 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:23.813900 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:23.814557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:23.836135 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:03:23.841071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for user 829a37a970b04d14a0b13b5d54ae2f24 and project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:03:23.907446 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:03:23.909853 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='884c3a77-016e-4238-9ecc-89df41e308ed',volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:03:23.961465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:23.963113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:23.969814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:23.970387 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:23.971075 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:23.971508 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:24.078047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-553afb1b-e7c4-492b-9195-edff0760710b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.932322 Aug 04 14:03:24.079193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 546/1066] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:03:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:03:24.089372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bb774945-2da3-4643-93dd-8544484fee58 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:24.089872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bb774945-2da3-4643-93dd-8544484fee58 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:24.111430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:24.123559 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:24.125273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:24.126583 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2cbb158a-fc14-467f-bc54-ad8a512d9475 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1807 microversion: 2.20 time: 0.169411 Aug 04 14:03:24.128262 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 521/1067] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:23 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:03:24.156904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bb774945-2da3-4643-93dd-8544484fee58 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:24.165917 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bb774945-2da3-4643-93dd-8544484fee58 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1095 microversion: 2.1 time: 0.080196 Aug 04 14:03:24.166490 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 547/1068] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:24 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:24.401531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1a8f371d-d338-4298-8540-0ab671816297 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:24.402339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1a8f371d-d338-4298-8540-0ab671816297 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:24.408346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a8f371d-d338-4298-8540-0ab671816297 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:24.408983 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a8f371d-d338-4298-8540-0ab671816297 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:24.409855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a8f371d-d338-4298-8540-0ab671816297 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:24.410402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1a8f371d-d338-4298-8540-0ab671816297 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:24.548973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1a8f371d-d338-4298-8540-0ab671816297 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:24.557216 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1a8f371d-d338-4298-8540-0ab671816297 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.159683 Aug 04 14:03:24.557800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 522/1069] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:24 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:24.667528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-946e6beb-91a8-4af2-bb0b-9fa800a4ad03 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:24.668154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-946e6beb-91a8-4af2-bb0b-9fa800a4ad03 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:24.673992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-946e6beb-91a8-4af2-bb0b-9fa800a4ad03 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:24.674439 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-946e6beb-91a8-4af2-bb0b-9fa800a4ad03 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:24.675206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-946e6beb-91a8-4af2-bb0b-9fa800a4ad03 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:24.675638 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-946e6beb-91a8-4af2-bb0b-9fa800a4ad03 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:24.797392 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-946e6beb-91a8-4af2-bb0b-9fa800a4ad03 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:24.804601 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-946e6beb-91a8-4af2-bb0b-9fa800a4ad03 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.141490 Aug 04 14:03:24.805193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 548/1070] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:24 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:25.149005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:25.150275 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:25.155666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:25.156113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:25.156935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:25.157361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:25.185282 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0ba8d01b-5140-49a3-8062-99cc5c946d45 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:25.186071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0ba8d01b-5140-49a3-8062-99cc5c946d45 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:25.193114 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ba8d01b-5140-49a3-8062-99cc5c946d45 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:25.193893 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ba8d01b-5140-49a3-8062-99cc5c946d45 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:25.194761 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ba8d01b-5140-49a3-8062-99cc5c946d45 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:25.195452 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ba8d01b-5140-49a3-8062-99cc5c946d45 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:25.281534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0ba8d01b-5140-49a3-8062-99cc5c946d45 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:25.292488 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0ba8d01b-5140-49a3-8062-99cc5c946d45 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1201 microversion: 2.1 time: 0.113118 Aug 04 14:03:25.293433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 549/1071] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:25 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1201 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:25.397807 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:25.407249 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:25.408843 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:25.410010 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2bb4c0ae-0284-4b5e-9387-39e6eba59c61 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1794 microversion: 2.20 time: 0.265326 Aug 04 14:03:25.410623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 523/1072] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:03:25 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1794 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:03:25.576907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dd656a49-50c2-46fc-948c-b34b6df9d13a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:25.577594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-dd656a49-50c2-46fc-948c-b34b6df9d13a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:25.584999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dd656a49-50c2-46fc-948c-b34b6df9d13a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:25.585527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dd656a49-50c2-46fc-948c-b34b6df9d13a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:25.586430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dd656a49-50c2-46fc-948c-b34b6df9d13a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:25.587515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dd656a49-50c2-46fc-948c-b34b6df9d13a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:25.723844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dd656a49-50c2-46fc-948c-b34b6df9d13a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:25.731618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-dd656a49-50c2-46fc-948c-b34b6df9d13a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.160016 Aug 04 14:03:25.732184 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 550/1073] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:25 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:25.820459 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-88a041e6-9bca-494b-b744-60e8f0c85fa3 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:25.821086 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-88a041e6-9bca-494b-b744-60e8f0c85fa3 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:25.827794 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-88a041e6-9bca-494b-b744-60e8f0c85fa3 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:25.828261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-88a041e6-9bca-494b-b744-60e8f0c85fa3 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:25.829040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-88a041e6-9bca-494b-b744-60e8f0c85fa3 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:25.829473 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-88a041e6-9bca-494b-b744-60e8f0c85fa3 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:26.030593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-88a041e6-9bca-494b-b744-60e8f0c85fa3 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:26.039638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-88a041e6-9bca-494b-b744-60e8f0c85fa3 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.222648 Aug 04 14:03:26.040758 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 524/1074] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:25 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:26.312472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-05a5e8d5-3466-4512-a3ce-aa0cd208ab9b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:26.314730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-05a5e8d5-3466-4512-a3ce-aa0cd208ab9b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:26.323908 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-05a5e8d5-3466-4512-a3ce-aa0cd208ab9b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:26.324800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-05a5e8d5-3466-4512-a3ce-aa0cd208ab9b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:26.325883 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-05a5e8d5-3466-4512-a3ce-aa0cd208ab9b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:26.326319 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-05a5e8d5-3466-4512-a3ce-aa0cd208ab9b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:26.470402 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-05a5e8d5-3466-4512-a3ce-aa0cd208ab9b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:26.478438 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-05a5e8d5-3466-4512-a3ce-aa0cd208ab9b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.169704 Aug 04 14:03:26.479386 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 551/1075] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:26 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:26.751246 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ec12bcaa-e0b0-45be-b8e4-c31ae57e60c7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:26.751851 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ec12bcaa-e0b0-45be-b8e4-c31ae57e60c7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:26.763779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ec12bcaa-e0b0-45be-b8e4-c31ae57e60c7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:26.764293 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ec12bcaa-e0b0-45be-b8e4-c31ae57e60c7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:26.767020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ec12bcaa-e0b0-45be-b8e4-c31ae57e60c7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:26.769186 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ec12bcaa-e0b0-45be-b8e4-c31ae57e60c7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:26.900614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-1adf8a54-b6ed-489c-89fa-e85338736f6d req-477d5ed6-52a7-4385-87d8-0695d8099df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d", "tag": "27e8d73b-a91d-45f1-8a1a-300b0d34f699"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:26.902630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:26.902630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:03:26.914568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-1adf8a54-b6ed-489c-89fa-e85338736f6d req-477d5ed6-52a7-4385-87d8-0695d8099df2 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:26.915555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-1adf8a54-b6ed-489c-89fa-e85338736f6d req-477d5ed6-52a7-4385-87d8-0695d8099df2 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:26.943704 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-1adf8a54-b6ed-489c-89fa-e85338736f6d req-477d5ed6-52a7-4385-87d8-0695d8099df2 service nova] Creating event network-changed:27e8d73b-a91d-45f1-8a1a-300b0d34f699 for instance cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d on hv-cinder-79264 Aug 04 14:03:26.952851 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-1adf8a54-b6ed-489c-89fa-e85338736f6d req-477d5ed6-52a7-4385-87d8-0695d8099df2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056929 Aug 04 14:03:26.953963 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 552/1076] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:03:27.004752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ec12bcaa-e0b0-45be-b8e4-c31ae57e60c7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:27.012135 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ec12bcaa-e0b0-45be-b8e4-c31ae57e60c7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.264586 Aug 04 14:03:27.023450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 525/1077] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:26 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:27.062486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b0d95ee3-065d-4e85-9942-3bd9af9db30c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:27.062486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b0d95ee3-065d-4e85-9942-3bd9af9db30c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:27.078440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b0d95ee3-065d-4e85-9942-3bd9af9db30c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:27.078904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b0d95ee3-065d-4e85-9942-3bd9af9db30c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:27.079708 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b0d95ee3-065d-4e85-9942-3bd9af9db30c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:27.082146 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b0d95ee3-065d-4e85-9942-3bd9af9db30c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:27.259968 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b0d95ee3-065d-4e85-9942-3bd9af9db30c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:27.274380 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b0d95ee3-065d-4e85-9942-3bd9af9db30c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.221149 Aug 04 14:03:27.286821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 553/1078] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:27 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:27.495224 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-25329e1c-d274-4654-a2f7-29f5cd8d8694 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:27.495839 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-25329e1c-d274-4654-a2f7-29f5cd8d8694 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:27.501720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25329e1c-d274-4654-a2f7-29f5cd8d8694 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:27.502176 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25329e1c-d274-4654-a2f7-29f5cd8d8694 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:27.502963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25329e1c-d274-4654-a2f7-29f5cd8d8694 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:27.503400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25329e1c-d274-4654-a2f7-29f5cd8d8694 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:27.676702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-25329e1c-d274-4654-a2f7-29f5cd8d8694 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:27.684513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-25329e1c-d274-4654-a2f7-29f5cd8d8694 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.193337 Aug 04 14:03:27.685090 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 526/1079] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:27 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:28.032146 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d49f58a1-9c2c-43b8-a25c-c4c8938ffb1c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:28.032798 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d49f58a1-9c2c-43b8-a25c-c4c8938ffb1c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:28.043489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d49f58a1-9c2c-43b8-a25c-c4c8938ffb1c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:28.044568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d49f58a1-9c2c-43b8-a25c-c4c8938ffb1c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:28.045977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d49f58a1-9c2c-43b8-a25c-c4c8938ffb1c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:28.046762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d49f58a1-9c2c-43b8-a25c-c4c8938ffb1c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:28.185558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d49f58a1-9c2c-43b8-a25c-c4c8938ffb1c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:28.193614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d49f58a1-9c2c-43b8-a25c-c4c8938ffb1c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.167415 Aug 04 14:03:28.194202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 554/1080] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:28 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:28.294901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-024e7117-ada5-4c42-b3bd-9e3a256e5165 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:28.295486 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-024e7117-ada5-4c42-b3bd-9e3a256e5165 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:28.301503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-024e7117-ada5-4c42-b3bd-9e3a256e5165 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:28.301948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-024e7117-ada5-4c42-b3bd-9e3a256e5165 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:28.302722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-024e7117-ada5-4c42-b3bd-9e3a256e5165 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:28.303151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-024e7117-ada5-4c42-b3bd-9e3a256e5165 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:28.465490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-024e7117-ada5-4c42-b3bd-9e3a256e5165 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:28.473271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-024e7117-ada5-4c42-b3bd-9e3a256e5165 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.182169 Aug 04 14:03:28.473868 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 527/1081] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:28 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:28.702275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3f3549ee-071d-4ae8-b8a2-9eff05f2c9bf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:28.702885 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3f3549ee-071d-4ae8-b8a2-9eff05f2c9bf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:28.709243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f3549ee-071d-4ae8-b8a2-9eff05f2c9bf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:28.709689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f3549ee-071d-4ae8-b8a2-9eff05f2c9bf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:28.710472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f3549ee-071d-4ae8-b8a2-9eff05f2c9bf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:28.710906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3f3549ee-071d-4ae8-b8a2-9eff05f2c9bf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:28.877707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3f3549ee-071d-4ae8-b8a2-9eff05f2c9bf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:28.887026 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3f3549ee-071d-4ae8-b8a2-9eff05f2c9bf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.188679 Aug 04 14:03:28.887618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 555/1082] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:28 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:29.211370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a4e0f2b8-c8e8-426d-8acb-c799cd2bdf1e tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:29.212510 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a4e0f2b8-c8e8-426d-8acb-c799cd2bdf1e tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:29.218619 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a4e0f2b8-c8e8-426d-8acb-c799cd2bdf1e tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:29.219063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a4e0f2b8-c8e8-426d-8acb-c799cd2bdf1e tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:29.219842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a4e0f2b8-c8e8-426d-8acb-c799cd2bdf1e tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:29.220289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a4e0f2b8-c8e8-426d-8acb-c799cd2bdf1e tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:29.356087 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a4e0f2b8-c8e8-426d-8acb-c799cd2bdf1e tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:29.364726 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a4e0f2b8-c8e8-426d-8acb-c799cd2bdf1e tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.156975 Aug 04 14:03:29.365553 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 528/1083] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:29 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:29.490296 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2d659e6d-f23d-4cc2-a3eb-52b8e75921c6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:29.490921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2d659e6d-f23d-4cc2-a3eb-52b8e75921c6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:29.497081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2d659e6d-f23d-4cc2-a3eb-52b8e75921c6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:29.497518 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2d659e6d-f23d-4cc2-a3eb-52b8e75921c6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:29.498302 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2d659e6d-f23d-4cc2-a3eb-52b8e75921c6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:29.498731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2d659e6d-f23d-4cc2-a3eb-52b8e75921c6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:29.630605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2d659e6d-f23d-4cc2-a3eb-52b8e75921c6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:29.645666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2d659e6d-f23d-4cc2-a3eb-52b8e75921c6 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.158660 Aug 04 14:03:29.646723 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 556/1084] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:29 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:29.903904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ce42ba9a-e94e-49d0-bea3-ee1b1e282dd6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:29.904579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ce42ba9a-e94e-49d0-bea3-ee1b1e282dd6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:29.910786 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce42ba9a-e94e-49d0-bea3-ee1b1e282dd6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:29.911270 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce42ba9a-e94e-49d0-bea3-ee1b1e282dd6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:29.912062 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce42ba9a-e94e-49d0-bea3-ee1b1e282dd6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:29.912530 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ce42ba9a-e94e-49d0-bea3-ee1b1e282dd6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:30.053953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ce42ba9a-e94e-49d0-bea3-ee1b1e282dd6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:30.066162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ce42ba9a-e94e-49d0-bea3-ee1b1e282dd6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.166016 Aug 04 14:03:30.066852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 529/1085] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:29 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:30.382741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ff447452-fdc6-4d4a-aafc-dcdf02fc34ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:30.383350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ff447452-fdc6-4d4a-aafc-dcdf02fc34ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:30.391729 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff447452-fdc6-4d4a-aafc-dcdf02fc34ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:30.392181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff447452-fdc6-4d4a-aafc-dcdf02fc34ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:30.393255 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff447452-fdc6-4d4a-aafc-dcdf02fc34ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:30.393842 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ff447452-fdc6-4d4a-aafc-dcdf02fc34ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:30.531983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ff447452-fdc6-4d4a-aafc-dcdf02fc34ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:30.540471 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ff447452-fdc6-4d4a-aafc-dcdf02fc34ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.161028 Aug 04 14:03:30.541432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 557/1086] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:30 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:30.666876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0acef301-1cad-4c8c-bb86-60b37908a786 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:30.667690 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0acef301-1cad-4c8c-bb86-60b37908a786 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:30.677666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0acef301-1cad-4c8c-bb86-60b37908a786 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:30.678456 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0acef301-1cad-4c8c-bb86-60b37908a786 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:30.679857 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0acef301-1cad-4c8c-bb86-60b37908a786 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:30.680579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0acef301-1cad-4c8c-bb86-60b37908a786 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:30.815738 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0acef301-1cad-4c8c-bb86-60b37908a786 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:30.825264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0acef301-1cad-4c8c-bb86-60b37908a786 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.164984 Aug 04 14:03:30.825870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 530/1087] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:30 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:30.940351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-2773b8a0-ff47-44fc-b291-4188f5c5bb51 req-1f96a869-46c7-4263-99de-d41dbf8a5398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246a1a60-bd1b-41f4-b264-35142d684f8d", "name": "network-vif-plugged", "status": "completed", "tag": "beceb660-6af5-4957-92be-e4d30ef7ad50"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:30.941979 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:30.941979 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:03:30.950178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-2773b8a0-ff47-44fc-b291-4188f5c5bb51 req-1f96a869-46c7-4263-99de-d41dbf8a5398 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:30.950675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-2773b8a0-ff47-44fc-b291-4188f5c5bb51 req-1f96a869-46c7-4263-99de-d41dbf8a5398 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:30.964027 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-2773b8a0-ff47-44fc-b291-4188f5c5bb51 req-1f96a869-46c7-4263-99de-d41dbf8a5398 service nova] Creating event network-vif-plugged:beceb660-6af5-4957-92be-e4d30ef7ad50 for instance 246a1a60-bd1b-41f4-b264-35142d684f8d on hv-cinder-79264 Aug 04 14:03:30.970673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-2773b8a0-ff47-44fc-b291-4188f5c5bb51 req-1f96a869-46c7-4263-99de-d41dbf8a5398 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034059 Aug 04 14:03:30.971440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 558/1088] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:03:31.090741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2cb71f7f-b712-45c1-bbf7-658aa43a247d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:31.091440 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2cb71f7f-b712-45c1-bbf7-658aa43a247d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:31.098653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cb71f7f-b712-45c1-bbf7-658aa43a247d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:31.099115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cb71f7f-b712-45c1-bbf7-658aa43a247d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:31.100362 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cb71f7f-b712-45c1-bbf7-658aa43a247d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:31.100977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cb71f7f-b712-45c1-bbf7-658aa43a247d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:31.289946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2cb71f7f-b712-45c1-bbf7-658aa43a247d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:31.297365 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2cb71f7f-b712-45c1-bbf7-658aa43a247d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.215337 Aug 04 14:03:31.297953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 531/1089] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:31 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:31.559124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-25335130-749d-46e3-a6fb-c6db138bf75c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:31.559800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-25335130-749d-46e3-a6fb-c6db138bf75c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:31.565971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-25335130-749d-46e3-a6fb-c6db138bf75c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:31.566410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-25335130-749d-46e3-a6fb-c6db138bf75c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:31.567279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-25335130-749d-46e3-a6fb-c6db138bf75c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:31.567708 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-25335130-749d-46e3-a6fb-c6db138bf75c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:31.695232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-25335130-749d-46e3-a6fb-c6db138bf75c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:31.703434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-25335130-749d-46e3-a6fb-c6db138bf75c tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.149316 Aug 04 14:03:31.704012 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 559/1090] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:31 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:31.841898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bac59378-1de7-4b26-8998-a2396e941bdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:31.842483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bac59378-1de7-4b26-8998-a2396e941bdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:31.848523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bac59378-1de7-4b26-8998-a2396e941bdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:31.848946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bac59378-1de7-4b26-8998-a2396e941bdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:31.849750 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bac59378-1de7-4b26-8998-a2396e941bdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:31.850185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bac59378-1de7-4b26-8998-a2396e941bdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:31.976045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bac59378-1de7-4b26-8998-a2396e941bdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:31.986999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bac59378-1de7-4b26-8998-a2396e941bdb tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.148268 Aug 04 14:03:31.987939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 532/1091] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:31 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:32.314510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-56bf6cc1-e8eb-444a-8fdb-2e96370e4da0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:32.315106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-56bf6cc1-e8eb-444a-8fdb-2e96370e4da0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:32.321001 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56bf6cc1-e8eb-444a-8fdb-2e96370e4da0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:32.321662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56bf6cc1-e8eb-444a-8fdb-2e96370e4da0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:32.322544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56bf6cc1-e8eb-444a-8fdb-2e96370e4da0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:32.323247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56bf6cc1-e8eb-444a-8fdb-2e96370e4da0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:32.459432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-56bf6cc1-e8eb-444a-8fdb-2e96370e4da0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:32.470401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-56bf6cc1-e8eb-444a-8fdb-2e96370e4da0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.159490 Aug 04 14:03:32.470992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 560/1092] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:32 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:32.721848 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-69685a63-e524-4576-93da-5c17c716a63d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:32.722468 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-69685a63-e524-4576-93da-5c17c716a63d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:32.729367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69685a63-e524-4576-93da-5c17c716a63d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:32.729819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69685a63-e524-4576-93da-5c17c716a63d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:32.730647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69685a63-e524-4576-93da-5c17c716a63d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:32.731082 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69685a63-e524-4576-93da-5c17c716a63d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:32.862185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-69685a63-e524-4576-93da-5c17c716a63d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:32.870357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-69685a63-e524-4576-93da-5c17c716a63d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1358 microversion: 2.1 time: 0.153492 Aug 04 14:03:32.870952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 533/1093] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:32 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:32.996504 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-a2cafde6-3e5d-40b4-b772-bb37c6ad9a4f req-4fe58afb-710b-492b-882f-5c8aaa4c57c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b05f2a-726a-417c-bdd9-6cedfd3d1980", "name": "network-vif-plugged", "status": "completed", "tag": "30375858-efad-4eb7-b5a3-c35704e441ff"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:32.998093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:32.998093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:03:33.006494 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c65bb138-9902-48d1-a521-70fffb38c115 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:33.006725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-a2cafde6-3e5d-40b4-b772-bb37c6ad9a4f req-4fe58afb-710b-492b-882f-5c8aaa4c57c6 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:33.007022 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-a2cafde6-3e5d-40b4-b772-bb37c6ad9a4f req-4fe58afb-710b-492b-882f-5c8aaa4c57c6 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:33.007145 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c65bb138-9902-48d1-a521-70fffb38c115 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:33.016905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c65bb138-9902-48d1-a521-70fffb38c115 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:33.017716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c65bb138-9902-48d1-a521-70fffb38c115 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:33.019141 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c65bb138-9902-48d1-a521-70fffb38c115 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:33.019929 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c65bb138-9902-48d1-a521-70fffb38c115 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:33.020049 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-a2cafde6-3e5d-40b4-b772-bb37c6ad9a4f req-4fe58afb-710b-492b-882f-5c8aaa4c57c6 service nova] Creating event network-vif-plugged:30375858-efad-4eb7-b5a3-c35704e441ff for instance d4b05f2a-726a-417c-bdd9-6cedfd3d1980 on hv-cinder-79264 Aug 04 14:03:33.026592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-a2cafde6-3e5d-40b4-b772-bb37c6ad9a4f req-4fe58afb-710b-492b-882f-5c8aaa4c57c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Aug 04 14:03:33.027207 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 561/1094] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:03:33.183025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c65bb138-9902-48d1-a521-70fffb38c115 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:33.191023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c65bb138-9902-48d1-a521-70fffb38c115 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.188410 Aug 04 14:03:33.191615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 534/1095] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:33 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:33.487343 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e11e5d9d-1fa0-4e3e-a50a-7d94ad99ba9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:33.488060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e11e5d9d-1fa0-4e3e-a50a-7d94ad99ba9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:33.494855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e11e5d9d-1fa0-4e3e-a50a-7d94ad99ba9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:33.495291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e11e5d9d-1fa0-4e3e-a50a-7d94ad99ba9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:33.496056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e11e5d9d-1fa0-4e3e-a50a-7d94ad99ba9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:33.496514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e11e5d9d-1fa0-4e3e-a50a-7d94ad99ba9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:33.623886 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e11e5d9d-1fa0-4e3e-a50a-7d94ad99ba9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:33.631593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e11e5d9d-1fa0-4e3e-a50a-7d94ad99ba9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.148271 Aug 04 14:03:33.632201 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 562/1096] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:33 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:33.892800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a81aa283-ab29-436f-9685-3cd0eff32612 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:33.893523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a81aa283-ab29-436f-9685-3cd0eff32612 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:33.900055 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a81aa283-ab29-436f-9685-3cd0eff32612 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:33.900532 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a81aa283-ab29-436f-9685-3cd0eff32612 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:33.901319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a81aa283-ab29-436f-9685-3cd0eff32612 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:33.901752 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a81aa283-ab29-436f-9685-3cd0eff32612 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.029066 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a81aa283-ab29-436f-9685-3cd0eff32612 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.036473 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a81aa283-ab29-436f-9685-3cd0eff32612 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1549 microversion: 2.1 time: 0.147539 Aug 04 14:03:34.037058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 535/1097] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:33 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:34.053314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b7c10403-d611-41df-9a74-4a0f301eb129 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.053916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b7c10403-d611-41df-9a74-4a0f301eb129 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:34.060613 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7c10403-d611-41df-9a74-4a0f301eb129 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.061056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7c10403-d611-41df-9a74-4a0f301eb129 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.061825 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7c10403-d611-41df-9a74-4a0f301eb129 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.062254 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7c10403-d611-41df-9a74-4a0f301eb129 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.194870 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b7c10403-d611-41df-9a74-4a0f301eb129 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.203440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b7c10403-d611-41df-9a74-4a0f301eb129 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1549 microversion: 2.1 time: 0.153753 Aug 04 14:03:34.204016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 563/1098] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:34 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:34.208823 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6a478baa-71f7-4590-ad49-cbdda19a24b2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.209440 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6a478baa-71f7-4590-ad49-cbdda19a24b2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:34.216402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6a478baa-71f7-4590-ad49-cbdda19a24b2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.216941 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6a478baa-71f7-4590-ad49-cbdda19a24b2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.217790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6a478baa-71f7-4590-ad49-cbdda19a24b2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.218314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6a478baa-71f7-4590-ad49-cbdda19a24b2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.221022 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.224340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:34.224340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:03:34.225350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.226102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Searching by: {'deleted': False, 'project_id': '0bd8064518c746d397f5d10d94300938'} {{(pid=107822) get_all /opt/stack/nova/nova/compute/api.py:2833}} Aug 04 14:03:34.233200 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.233679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.234435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.234897 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.331233 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.multi_cell_list [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107822) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 04 14:03:34.351057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6a478baa-71f7-4590-ad49-cbdda19a24b2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.359839 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6a478baa-71f7-4590-ad49-cbdda19a24b2 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1319 microversion: 2.1 time: 0.154660 Aug 04 14:03:34.360471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 536/1099] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:34 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:34.431258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-03b7942b-b534-42c7-aae9-4519bcc14bf2 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214691 Aug 04 14:03:34.431755 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 564/1100] 10.222.0.43 () {58 vars in 1125 bytes} [Wed Aug 4 14:03:34 2021] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:03:34.442204 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f8c02d0c-3d94-4a2d-8c75-2387e1151747 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.442833 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f8c02d0c-3d94-4a2d-8c75-2387e1151747 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:34.450971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8c02d0c-3d94-4a2d-8c75-2387e1151747 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.451459 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8c02d0c-3d94-4a2d-8c75-2387e1151747 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.452392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8c02d0c-3d94-4a2d-8c75-2387e1151747 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.452824 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f8c02d0c-3d94-4a2d-8c75-2387e1151747 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.582364 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f8c02d0c-3d94-4a2d-8c75-2387e1151747 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.590260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f8c02d0c-3d94-4a2d-8c75-2387e1151747 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1549 microversion: 2.1 time: 0.152167 Aug 04 14:03:34.590851 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 537/1101] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:34 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:34.648646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-50556982-7e96-4b19-8ce1-00e3efe3c8e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.649298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-50556982-7e96-4b19-8ce1-00e3efe3c8e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:34.655282 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50556982-7e96-4b19-8ce1-00e3efe3c8e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.655722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50556982-7e96-4b19-8ce1-00e3efe3c8e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.656564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50556982-7e96-4b19-8ce1-00e3efe3c8e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:34.656968 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50556982-7e96-4b19-8ce1-00e3efe3c8e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:34.797629 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-50556982-7e96-4b19-8ce1-00e3efe3c8e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.806108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-50556982-7e96-4b19-8ce1-00e3efe3c8e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.160581 Aug 04 14:03:34.807224 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 565/1102] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:34 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:35.382658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-92c017ab-077b-4f46-b724-d859ba66b31b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:35.383999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-92c017ab-077b-4f46-b724-d859ba66b31b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:35.392641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92c017ab-077b-4f46-b724-d859ba66b31b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:35.393054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92c017ab-077b-4f46-b724-d859ba66b31b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:35.393928 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92c017ab-077b-4f46-b724-d859ba66b31b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:35.394334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92c017ab-077b-4f46-b724-d859ba66b31b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:35.527343 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-92c017ab-077b-4f46-b724-d859ba66b31b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:35.535010 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-92c017ab-077b-4f46-b724-d859ba66b31b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1507 microversion: 2.1 time: 0.156065 Aug 04 14:03:35.535597 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 538/1103] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:35 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:35.551547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-30a75c3d-f371-4692-bb43-1256f9ec91cd tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84845721-727a-4392-86d7-f988354e449b", "device": "/dev/sdb"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:35.552644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-30a75c3d-f371-4692-bb43-1256f9ec91cd tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:35.559474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-30a75c3d-f371-4692-bb43-1256f9ec91cd tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:35.559976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-30a75c3d-f371-4692-bb43-1256f9ec91cd tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:35.560800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-30a75c3d-f371-4692-bb43-1256f9ec91cd tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:35.561340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-30a75c3d-f371-4692-bb43-1256f9ec91cd tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:35.823500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-30a75c3d-f371-4692-bb43-1256f9ec91cd tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "POST /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275255 Aug 04 14:03:35.824496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 566/1104] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 14:03:35 2021] POST /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:35.824963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-680bf0ff-02d4-4f93-a680-9f8192dab461 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:35.825580 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-680bf0ff-02d4-4f93-a680-9f8192dab461 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:35.833110 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680bf0ff-02d4-4f93-a680-9f8192dab461 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:35.833585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680bf0ff-02d4-4f93-a680-9f8192dab461 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:35.834745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680bf0ff-02d4-4f93-a680-9f8192dab461 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:35.835180 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680bf0ff-02d4-4f93-a680-9f8192dab461 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:35.979452 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-680bf0ff-02d4-4f93-a680-9f8192dab461 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:35.986787 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-680bf0ff-02d4-4f93-a680-9f8192dab461 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.167343 Aug 04 14:03:35.987370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 539/1105] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:35 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:36.159026 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2c457770-3ed4-4a56-8bf7-44e3999cf2ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb50c90-c004-4175-bc28-896a7ed2ac30"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:36.160449 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2c457770-3ed4-4a56-8bf7-44e3999cf2ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:36.167734 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2c457770-3ed4-4a56-8bf7-44e3999cf2ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:36.168402 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2c457770-3ed4-4a56-8bf7-44e3999cf2ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:36.169731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2c457770-3ed4-4a56-8bf7-44e3999cf2ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:36.170513 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2c457770-3ed4-4a56-8bf7-44e3999cf2ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:36.447206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2c457770-3ed4-4a56-8bf7-44e3999cf2ad tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "POST /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291749 Aug 04 14:03:36.448187 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 567/1106] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 14:03:36 2021] POST /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:37.004753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5b848bdd-9286-4495-b718-bfc95de77c9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:37.005339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5b848bdd-9286-4495-b718-bfc95de77c9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:37.011535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b848bdd-9286-4495-b718-bfc95de77c9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:37.011985 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b848bdd-9286-4495-b718-bfc95de77c9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:37.012962 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b848bdd-9286-4495-b718-bfc95de77c9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:37.013389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b848bdd-9286-4495-b718-bfc95de77c9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:37.151544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5b848bdd-9286-4495-b718-bfc95de77c9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:37.159345 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5b848bdd-9286-4495-b718-bfc95de77c9a tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.157989 Aug 04 14:03:37.159923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 540/1107] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:36 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:37.704688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:03:37.704997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:03:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:03:38.178966 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5059ab11-0270-4cee-b099-8af25be5d7f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:38.179663 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5059ab11-0270-4cee-b099-8af25be5d7f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:38.187249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5059ab11-0270-4cee-b099-8af25be5d7f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:38.187695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5059ab11-0270-4cee-b099-8af25be5d7f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:38.188498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5059ab11-0270-4cee-b099-8af25be5d7f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:38.188926 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5059ab11-0270-4cee-b099-8af25be5d7f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:38.317549 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5059ab11-0270-4cee-b099-8af25be5d7f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:38.326723 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5059ab11-0270-4cee-b099-8af25be5d7f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.152258 Aug 04 14:03:38.327290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 568/1108] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:38 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:38.973646 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-0940b135-1fcf-4b86-ab68-1a268f0d6d78 req-488b2906-9b77-41ea-8472-ce0a4a62d59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d", "name": "network-vif-plugged", "status": "completed", "tag": "27e8d73b-a91d-45f1-8a1a-300b0d34f699"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:38.975278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:38.975278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:03:38.983450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-0940b135-1fcf-4b86-ab68-1a268f0d6d78 req-488b2906-9b77-41ea-8472-ce0a4a62d59a service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:38.983879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-0940b135-1fcf-4b86-ab68-1a268f0d6d78 req-488b2906-9b77-41ea-8472-ce0a4a62d59a service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:38.997364 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-0940b135-1fcf-4b86-ab68-1a268f0d6d78 req-488b2906-9b77-41ea-8472-ce0a4a62d59a service nova] Creating event network-vif-plugged:27e8d73b-a91d-45f1-8a1a-300b0d34f699 for instance cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d on hv-cinder-79264 Aug 04 14:03:39.002357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-0940b135-1fcf-4b86-ab68-1a268f0d6d78 req-488b2906-9b77-41ea-8472-ce0a4a62d59a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032838 Aug 04 14:03:39.003028 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 541/1109] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:03:39.343654 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6a492a2e-8c44-44bb-84d7-727e577cd916 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:39.344320 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6a492a2e-8c44-44bb-84d7-727e577cd916 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:39.350383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a492a2e-8c44-44bb-84d7-727e577cd916 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:39.350844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a492a2e-8c44-44bb-84d7-727e577cd916 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:39.351605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a492a2e-8c44-44bb-84d7-727e577cd916 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:39.352080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6a492a2e-8c44-44bb-84d7-727e577cd916 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:39.494351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6a492a2e-8c44-44bb-84d7-727e577cd916 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:39.502130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6a492a2e-8c44-44bb-84d7-727e577cd916 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.162297 Aug 04 14:03:39.502750 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 569/1110] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:39 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:39.754316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-69c0e91d-f1b2-4401-aa12-37cf6ac2948a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:39.754883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-69c0e91d-f1b2-4401-aa12-37cf6ac2948a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:39.761973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69c0e91d-f1b2-4401-aa12-37cf6ac2948a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:39.762415 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69c0e91d-f1b2-4401-aa12-37cf6ac2948a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:39.763197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69c0e91d-f1b2-4401-aa12-37cf6ac2948a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:39.763627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69c0e91d-f1b2-4401-aa12-37cf6ac2948a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:39.868647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-69c0e91d-f1b2-4401-aa12-37cf6ac2948a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lazy-loading 'services' on Instance uuid 2c1349a3-e392-480b-84ed-d851137f5a0c {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:03:39.936146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-69c0e91d-f1b2-4401-aa12-37cf6ac2948a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/os-volume_attachments/1210f66a-f880-4569-a887-3182772e47f6" status: 202 len: 0 microversion: 2.1 time: 0.406796 Aug 04 14:03:39.936784 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 542/1111] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:03:39 2021] DELETE /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/os-volume_attachments/1210f66a-f880-4569-a887-3182772e47f6 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:03:40.519561 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-64eb62bd-75f3-40f6-9581-a2b7f104f440 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:40.520183 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-64eb62bd-75f3-40f6-9581-a2b7f104f440 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:40.528420 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-64eb62bd-75f3-40f6-9581-a2b7f104f440 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:40.528880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-64eb62bd-75f3-40f6-9581-a2b7f104f440 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:40.529658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-64eb62bd-75f3-40f6-9581-a2b7f104f440 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:40.530081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-64eb62bd-75f3-40f6-9581-a2b7f104f440 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:40.657781 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-64eb62bd-75f3-40f6-9581-a2b7f104f440 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:40.666346 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-64eb62bd-75f3-40f6-9581-a2b7f104f440 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1267 microversion: 2.1 time: 0.150445 Aug 04 14:03:40.666932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 570/1112] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:40 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:41.685060 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7dd50349-58a8-4200-9e69-23bccf15f2f7 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:41.685908 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7dd50349-58a8-4200-9e69-23bccf15f2f7 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:41.692117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7dd50349-58a8-4200-9e69-23bccf15f2f7 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:41.692606 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7dd50349-58a8-4200-9e69-23bccf15f2f7 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:41.693536 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7dd50349-58a8-4200-9e69-23bccf15f2f7 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:41.694012 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7dd50349-58a8-4200-9e69-23bccf15f2f7 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:41.839319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7dd50349-58a8-4200-9e69-23bccf15f2f7 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:41.846996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7dd50349-58a8-4200-9e69-23bccf15f2f7 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1455 microversion: 2.1 time: 0.167368 Aug 04 14:03:41.847564 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 543/1113] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:41 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:41.864122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a003f731-8067-4727-8395-4b0e6667250f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:41.864756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a003f731-8067-4727-8395-4b0e6667250f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:41.872157 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a003f731-8067-4727-8395-4b0e6667250f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:41.872623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a003f731-8067-4727-8395-4b0e6667250f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:41.873401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a003f731-8067-4727-8395-4b0e6667250f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:41.873821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a003f731-8067-4727-8395-4b0e6667250f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:42.005411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a003f731-8067-4727-8395-4b0e6667250f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:42.013977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a003f731-8067-4727-8395-4b0e6667250f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1455 microversion: 2.1 time: 0.153115 Aug 04 14:03:42.014563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 571/1114] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:41 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:44.086302 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-ee80bbeb-9f59-4711-86fa-61d7dfc5bc15 req-7f9a04f5-4e9d-4029-92d5-479528f46625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d", "tag": "27e8d73b-a91d-45f1-8a1a-300b0d34f699"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:44.088517 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:44.088517 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:03:44.095520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ee80bbeb-9f59-4711-86fa-61d7dfc5bc15 req-7f9a04f5-4e9d-4029-92d5-479528f46625 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:44.095958 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ee80bbeb-9f59-4711-86fa-61d7dfc5bc15 req-7f9a04f5-4e9d-4029-92d5-479528f46625 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:44.107639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-ee80bbeb-9f59-4711-86fa-61d7dfc5bc15 req-7f9a04f5-4e9d-4029-92d5-479528f46625 service nova] Creating event network-changed:27e8d73b-a91d-45f1-8a1a-300b0d34f699 for instance cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d on hv-cinder-79264 Aug 04 14:03:44.112813 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-ee80bbeb-9f59-4711-86fa-61d7dfc5bc15 req-7f9a04f5-4e9d-4029-92d5-479528f46625 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030099 Aug 04 14:03:44.113439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 544/1115] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:52.556920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8db131cb-b2d2-4ebd-bd5c-e5e9dd495a40 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:52.557530 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8db131cb-b2d2-4ebd-bd5c-e5e9dd495a40 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:52.563733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8db131cb-b2d2-4ebd-bd5c-e5e9dd495a40 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:52.564179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8db131cb-b2d2-4ebd-bd5c-e5e9dd495a40 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:52.564974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8db131cb-b2d2-4ebd-bd5c-e5e9dd495a40 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:52.565401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8db131cb-b2d2-4ebd-bd5c-e5e9dd495a40 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:52.688465 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8db131cb-b2d2-4ebd-bd5c-e5e9dd495a40 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:52.696371 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8db131cb-b2d2-4ebd-bd5c-e5e9dd495a40 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1595 microversion: 2.1 time: 0.143928 Aug 04 14:03:52.697114 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 572/1116] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:52 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1595 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:54.653056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-78e14709-28c7-4d18-9979-bc6ae92da635 req-ca41e9ae-a615-4289-9f2b-eac63def408c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246a1a60-bd1b-41f4-b264-35142d684f8d", "tag": "beceb660-6af5-4957-92be-e4d30ef7ad50"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:54.654677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:54.654677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:03:54.661642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-78e14709-28c7-4d18-9979-bc6ae92da635 req-ca41e9ae-a615-4289-9f2b-eac63def408c service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:54.662080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-78e14709-28c7-4d18-9979-bc6ae92da635 req-ca41e9ae-a615-4289-9f2b-eac63def408c service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:54.676859 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-78e14709-28c7-4d18-9979-bc6ae92da635 req-ca41e9ae-a615-4289-9f2b-eac63def408c service nova] Creating event network-changed:beceb660-6af5-4957-92be-e4d30ef7ad50 for instance 246a1a60-bd1b-41f4-b264-35142d684f8d on hv-cinder-79264 Aug 04 14:03:54.683608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-78e14709-28c7-4d18-9979-bc6ae92da635 req-ca41e9ae-a615-4289-9f2b-eac63def408c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035637 Aug 04 14:03:54.684201 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 545/1117] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:55.575405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e28e586f-7d16-47b2-96b3-e413bb059619 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1409387756"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:55.576073 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e28e586f-7d16-47b2-96b3-e413bb059619 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:55.582586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e28e586f-7d16-47b2-96b3-e413bb059619 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:55.583112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e28e586f-7d16-47b2-96b3-e413bb059619 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:55.583955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e28e586f-7d16-47b2-96b3-e413bb059619 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:55.584608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e28e586f-7d16-47b2-96b3-e413bb059619 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:55.707982 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.network.security_group_api [None req-e28e586f-7d16-47b2-96b3-e413bb059619 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Adding security group 54754f91-d567-449f-a15a-a11095ae7a26 to port beceb660-6af5-4957-92be-e4d30ef7ad50 Aug 04 14:03:56.074174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e28e586f-7d16-47b2-96b3-e413bb059619 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "POST /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/action" status: 202 len: 0 microversion: 2.1 time: 0.502368 Aug 04 14:03:56.075256 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 573/1118] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:03:55 2021] POST /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:03:56.077703 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-ff952d73-fc4d-4b0f-bc56-f0e89c3f6ccc req-fdcc92c2-758a-4903-84bc-3ad5671400c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246a1a60-bd1b-41f4-b264-35142d684f8d", "tag": "beceb660-6af5-4957-92be-e4d30ef7ad50"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:56.088949 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:03:56.088949 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:03:56.089863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-00e4d18e-2dc3-4cee-a58e-ba2a6383c4d4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:56.091225 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-00e4d18e-2dc3-4cee-a58e-ba2a6383c4d4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:56.106317 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ff952d73-fc4d-4b0f-bc56-f0e89c3f6ccc req-fdcc92c2-758a-4903-84bc-3ad5671400c0 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:56.112605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ff952d73-fc4d-4b0f-bc56-f0e89c3f6ccc req-fdcc92c2-758a-4903-84bc-3ad5671400c0 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:56.113426 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00e4d18e-2dc3-4cee-a58e-ba2a6383c4d4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:56.118725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00e4d18e-2dc3-4cee-a58e-ba2a6383c4d4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:56.119784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00e4d18e-2dc3-4cee-a58e-ba2a6383c4d4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:56.120573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-00e4d18e-2dc3-4cee-a58e-ba2a6383c4d4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:56.133687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-ff952d73-fc4d-4b0f-bc56-f0e89c3f6ccc req-fdcc92c2-758a-4903-84bc-3ad5671400c0 service nova] Creating event network-changed:beceb660-6af5-4957-92be-e4d30ef7ad50 for instance 246a1a60-bd1b-41f4-b264-35142d684f8d on hv-cinder-79264 Aug 04 14:03:56.151410 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-ff952d73-fc4d-4b0f-bc56-f0e89c3f6ccc req-fdcc92c2-758a-4903-84bc-3ad5671400c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078166 Aug 04 14:03:56.153286 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 546/1119] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:03:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:03:56.306128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-00e4d18e-2dc3-4cee-a58e-ba2a6383c4d4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:56.314602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-00e4d18e-2dc3-4cee-a58e-ba2a6383c4d4 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1642 microversion: 2.1 time: 0.234973 Aug 04 14:03:56.315426 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 574/1120] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:56 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1642 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:58.060624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ef48c4d9-d58a-40ff-acbb-388de5c035bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:58.066501 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef48c4d9-d58a-40ff-acbb-388de5c035bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:58.066937 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef48c4d9-d58a-40ff-acbb-388de5c035bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:58.089770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ef48c4d9-d58a-40ff-acbb-388de5c035bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Going to try to stop instance {{(pid=107823) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 04 14:03:58.131994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ef48c4d9-d58a-40ff-acbb-388de5c035bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.075295 Aug 04 14:03:58.132623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 547/1121] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:03:58 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:03:58.140478 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-95a9fed8-7f3e-4b2b-8d7d-6f7efec4d176 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:58.141079 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-95a9fed8-7f3e-4b2b-8d7d-6f7efec4d176 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:58.146896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95a9fed8-7f3e-4b2b-8d7d-6f7efec4d176 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:58.147351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95a9fed8-7f3e-4b2b-8d7d-6f7efec4d176 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:58.148241 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95a9fed8-7f3e-4b2b-8d7d-6f7efec4d176 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:58.148807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95a9fed8-7f3e-4b2b-8d7d-6f7efec4d176 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:58.276954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-95a9fed8-7f3e-4b2b-8d7d-6f7efec4d176 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:58.286942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-95a9fed8-7f3e-4b2b-8d7d-6f7efec4d176 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.149965 Aug 04 14:03:58.287515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 575/1122] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:58 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:59.304900 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-21d4457f-8096-4743-b443-a4a2bea9677a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:59.305653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-21d4457f-8096-4743-b443-a4a2bea9677a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:03:59.311668 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21d4457f-8096-4743-b443-a4a2bea9677a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:59.312116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21d4457f-8096-4743-b443-a4a2bea9677a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:59.312922 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21d4457f-8096-4743-b443-a4a2bea9677a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:03:59.313350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-21d4457f-8096-4743-b443-a4a2bea9677a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:03:59.444460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-21d4457f-8096-4743-b443-a4a2bea9677a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:59.452849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-21d4457f-8096-4743-b443-a4a2bea9677a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.152293 Aug 04 14:03:59.453425 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 548/1123] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:03:59 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:00.409169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9a64a91e-bc20-4eea-9088-3f42e5d9687e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:00.410034 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9a64a91e-bc20-4eea-9088-3f42e5d9687e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:00.420716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a64a91e-bc20-4eea-9088-3f42e5d9687e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:00.421168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a64a91e-bc20-4eea-9088-3f42e5d9687e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:00.422487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a64a91e-bc20-4eea-9088-3f42e5d9687e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:00.423326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a64a91e-bc20-4eea-9088-3f42e5d9687e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:00.470308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-829afd70-0a27-42d7-a393-d043d581aa2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:00.470912 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-829afd70-0a27-42d7-a393-d043d581aa2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:00.477202 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-829afd70-0a27-42d7-a393-d043d581aa2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:00.477654 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-829afd70-0a27-42d7-a393-d043d581aa2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:00.478422 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-829afd70-0a27-42d7-a393-d043d581aa2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:00.478842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-829afd70-0a27-42d7-a393-d043d581aa2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:00.512273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-9a64a91e-bc20-4eea-9088-3f42e5d9687e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lazy-loading 'services' on Instance uuid d4b05f2a-726a-417c-bdd9-6cedfd3d1980 {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:04:00.579823 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9a64a91e-bc20-4eea-9088-3f42e5d9687e tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980/os-volume_attachments/84845721-727a-4392-86d7-f988354e449b" status: 202 len: 0 microversion: 2.1 time: 0.176180 Aug 04 14:04:00.580463 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 576/1124] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:04:00 2021] DELETE /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980/os-volume_attachments/84845721-727a-4392-86d7-f988354e449b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:04:00.611009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-829afd70-0a27-42d7-a393-d043d581aa2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:00.619406 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-829afd70-0a27-42d7-a393-d043d581aa2b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.152448 Aug 04 14:04:00.619995 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 549/1125] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:00 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:01.637054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b493f390-ea6a-46ad-a4d4-be556ad82591 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:01.637645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b493f390-ea6a-46ad-a4d4-be556ad82591 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:01.643867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b493f390-ea6a-46ad-a4d4-be556ad82591 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:01.644337 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b493f390-ea6a-46ad-a4d4-be556ad82591 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:01.645090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b493f390-ea6a-46ad-a4d4-be556ad82591 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:01.645512 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b493f390-ea6a-46ad-a4d4-be556ad82591 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:01.773867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b493f390-ea6a-46ad-a4d4-be556ad82591 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:01.781458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b493f390-ea6a-46ad-a4d4-be556ad82591 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.149581 Aug 04 14:04:01.782039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 577/1126] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:01 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:02.763855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-64fc22cf-c87f-43ea-9ac2-04f195e4147d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:02.764397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-64fc22cf-c87f-43ea-9ac2-04f195e4147d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:02.770154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64fc22cf-c87f-43ea-9ac2-04f195e4147d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:02.770596 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64fc22cf-c87f-43ea-9ac2-04f195e4147d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:02.771355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64fc22cf-c87f-43ea-9ac2-04f195e4147d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:02.771775 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-64fc22cf-c87f-43ea-9ac2-04f195e4147d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:02.796793 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-64fc22cf-c87f-43ea-9ac2-04f195e4147d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:04:02.798581 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0cb44325-af74-4c46-89a8-9c9f39ffead6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:02.799225 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0cb44325-af74-4c46-89a8-9c9f39ffead6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:02.805010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0cb44325-af74-4c46-89a8-9c9f39ffead6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:02.805548 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0cb44325-af74-4c46-89a8-9c9f39ffead6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:02.806307 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0cb44325-af74-4c46-89a8-9c9f39ffead6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:02.806737 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0cb44325-af74-4c46-89a8-9c9f39ffead6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:02.874251 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-64fc22cf-c87f-43ea-9ac2-04f195e4147d tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 204 len: 0 microversion: 2.1 time: 0.113806 Aug 04 14:04:02.874963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 550/1127] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:04:02 2021] DELETE /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:02.883936 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-62e7fbe1-8df2-46e1-8e0e-c478e89f4e93 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:02.884685 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-62e7fbe1-8df2-46e1-8e0e-c478e89f4e93 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:02.890798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-62e7fbe1-8df2-46e1-8e0e-c478e89f4e93 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:02.891941 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-62e7fbe1-8df2-46e1-8e0e-c478e89f4e93 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:02.892053 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-62e7fbe1-8df2-46e1-8e0e-c478e89f4e93 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:02.892479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-62e7fbe1-8df2-46e1-8e0e-c478e89f4e93 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:02.934819 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0cb44325-af74-4c46-89a8-9c9f39ffead6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:02.942110 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0cb44325-af74-4c46-89a8-9c9f39ffead6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.147087 Aug 04 14:04:02.942683 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 578/1128] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:02 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:03.021881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-62e7fbe1-8df2-46e1-8e0e-c478e89f4e93 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:03.029901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-62e7fbe1-8df2-46e1-8e0e-c478e89f4e93 tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1513 microversion: 2.1 time: 0.150030 Aug 04 14:04:03.030479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 551/1129] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:02 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:03.959684 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9cb98027-abe0-4613-b5dd-89c92eb29160 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:03.960305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9cb98027-abe0-4613-b5dd-89c92eb29160 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:03.966747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9cb98027-abe0-4613-b5dd-89c92eb29160 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:03.967223 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9cb98027-abe0-4613-b5dd-89c92eb29160 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:03.967981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9cb98027-abe0-4613-b5dd-89c92eb29160 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:03.968444 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9cb98027-abe0-4613-b5dd-89c92eb29160 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:04.046673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5c2e5aa5-7ec5-49c5-b0e1-26d322efe2fe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:04.047262 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5c2e5aa5-7ec5-49c5-b0e1-26d322efe2fe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:04.053311 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c2e5aa5-7ec5-49c5-b0e1-26d322efe2fe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:04.053757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c2e5aa5-7ec5-49c5-b0e1-26d322efe2fe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:04.054561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c2e5aa5-7ec5-49c5-b0e1-26d322efe2fe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:04.054995 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c2e5aa5-7ec5-49c5-b0e1-26d322efe2fe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:04.091267 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9cb98027-abe0-4613-b5dd-89c92eb29160 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:04.098674 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9cb98027-abe0-4613-b5dd-89c92eb29160 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.142594 Aug 04 14:04:04.099242 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 579/1130] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:03 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:04.177678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5c2e5aa5-7ec5-49c5-b0e1-26d322efe2fe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:04.185361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5c2e5aa5-7ec5-49c5-b0e1-26d322efe2fe tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1513 microversion: 2.1 time: 0.142241 Aug 04 14:04:04.185934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 552/1131] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:04 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:05.115930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-89943185-1890-4079-b584-84c82d68202b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:05.116560 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-89943185-1890-4079-b584-84c82d68202b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:05.123048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-89943185-1890-4079-b584-84c82d68202b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:05.123499 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-89943185-1890-4079-b584-84c82d68202b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:05.124300 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-89943185-1890-4079-b584-84c82d68202b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:05.124824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-89943185-1890-4079-b584-84c82d68202b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:05.202264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-49bb5181-ed16-4b79-a2b9-22cf9f87b25c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:05.202878 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-49bb5181-ed16-4b79-a2b9-22cf9f87b25c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:05.208684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-49bb5181-ed16-4b79-a2b9-22cf9f87b25c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:05.209123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-49bb5181-ed16-4b79-a2b9-22cf9f87b25c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:05.209888 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-49bb5181-ed16-4b79-a2b9-22cf9f87b25c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:05.210323 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-49bb5181-ed16-4b79-a2b9-22cf9f87b25c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:05.245143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-89943185-1890-4079-b584-84c82d68202b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:05.252558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-89943185-1890-4079-b584-84c82d68202b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.140156 Aug 04 14:04:05.253121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 580/1132] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:05 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:05.334574 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-49bb5181-ed16-4b79-a2b9-22cf9f87b25c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:05.342601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-49bb5181-ed16-4b79-a2b9-22cf9f87b25c tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1513 microversion: 2.1 time: 0.144337 Aug 04 14:04:05.343359 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 553/1133] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:05 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:05.880746 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-2c38326b-32c4-453a-a2ea-147f58d862fc req-a8cd92ef-4ef8-42fe-9778-201f86a957b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b05f2a-726a-417c-bdd9-6cedfd3d1980", "name": "network-vif-deleted", "tag": "30375858-efad-4eb7-b5a3-c35704e441ff"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:05.882357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:04:05.882357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:04:05.890080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-2c38326b-32c4-453a-a2ea-147f58d862fc req-a8cd92ef-4ef8-42fe-9778-201f86a957b0 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:05.890523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-2c38326b-32c4-453a-a2ea-147f58d862fc req-a8cd92ef-4ef8-42fe-9778-201f86a957b0 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:05.901524 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-2c38326b-32c4-453a-a2ea-147f58d862fc req-a8cd92ef-4ef8-42fe-9778-201f86a957b0 service nova] Creating event network-vif-deleted:30375858-efad-4eb7-b5a3-c35704e441ff for instance d4b05f2a-726a-417c-bdd9-6cedfd3d1980 on hv-cinder-79264 Aug 04 14:04:05.906667 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-2c38326b-32c4-453a-a2ea-147f58d862fc req-a8cd92ef-4ef8-42fe-9778-201f86a957b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029526 Aug 04 14:04:05.907279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 581/1134] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:04:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:06.269578 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c709ef63-ef2e-4624-81fe-154692a8fbab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:06.270164 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c709ef63-ef2e-4624-81fe-154692a8fbab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:06.276599 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c709ef63-ef2e-4624-81fe-154692a8fbab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:06.277038 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c709ef63-ef2e-4624-81fe-154692a8fbab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:06.277798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c709ef63-ef2e-4624-81fe-154692a8fbab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:06.278227 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c709ef63-ef2e-4624-81fe-154692a8fbab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:06.360275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:06.360974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:06.368083 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:06.369158 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:06.369430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:06.369859 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:06.405677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c709ef63-ef2e-4624-81fe-154692a8fbab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:06.407560 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:06.408004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:06.408480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lazy-loading 'fault' on Instance uuid d4b05f2a-726a-417c-bdd9-6cedfd3d1980 {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:04:06.413335 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c709ef63-ef2e-4624-81fe-154692a8fbab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.147367 Aug 04 14:04:06.414479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 554/1135] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:06 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:06.461822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d38a2823d944bc8bace34cc344960e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46936a5606ce4e148713e2709548faaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:06.463061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-eeb3e5cf-cd41-4218-a0a8-d537162fd99b tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 200 len: 1309 microversion: 2.1 time: 0.106409 Aug 04 14:04:06.463376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 582/1136] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:06 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:07.431438 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8e073ef9-9766-4b1b-956c-2b967fd7f742 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:07.432061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8e073ef9-9766-4b1b-956c-2b967fd7f742 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:07.437916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e073ef9-9766-4b1b-956c-2b967fd7f742 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:07.438357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e073ef9-9766-4b1b-956c-2b967fd7f742 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:07.439109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e073ef9-9766-4b1b-956c-2b967fd7f742 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:07.439531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e073ef9-9766-4b1b-956c-2b967fd7f742 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:07.481267 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:07.481898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] [instance: d4b05f2a-726a-417c-bdd9-6cedfd3d1980] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:07.487864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:07.488374 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:07.489146 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:07.489576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:07.503260 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] HTTP exception thrown: Instance d4b05f2a-726a-417c-bdd9-6cedfd3d1980 could not be found. Aug 04 14:04:07.503860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] Returning 404 to user: Instance d4b05f2a-726a-417c-bdd9-6cedfd3d1980 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:04:07.504706 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d1695325-533d-45ed-b2c6-f46d4adf8cca tempest-VolumesSnapshotTestJSON-370324735 tempest-VolumesSnapshotTestJSON-370324735-project] 10.222.0.43 "GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980" status: 404 len: 111 microversion: 2.1 time: 0.027234 Aug 04 14:04:07.505252 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 583/1137] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:07 2021] GET /compute/v2.1/servers/d4b05f2a-726a-417c-bdd9-6cedfd3d1980 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:04:07.566639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8e073ef9-9766-4b1b-956c-2b967fd7f742 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:07.574498 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8e073ef9-9766-4b1b-956c-2b967fd7f742 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.147343 Aug 04 14:04:07.575307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 555/1138] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:07 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:08.591447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fb9ec40e-3d0a-420f-afcc-3400981216ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:08.592028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fb9ec40e-3d0a-420f-afcc-3400981216ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:08.597871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb9ec40e-3d0a-420f-afcc-3400981216ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:08.598314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb9ec40e-3d0a-420f-afcc-3400981216ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:08.599082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb9ec40e-3d0a-420f-afcc-3400981216ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:08.599515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fb9ec40e-3d0a-420f-afcc-3400981216ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:08.719910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fb9ec40e-3d0a-420f-afcc-3400981216ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:08.727500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fb9ec40e-3d0a-420f-afcc-3400981216ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.139736 Aug 04 14:04:08.728129 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 584/1139] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:08 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:09.745239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-71c4b369-ed10-4e7c-a8f9-79a7098fcf25 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:09.745869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-71c4b369-ed10-4e7c-a8f9-79a7098fcf25 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:09.751623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71c4b369-ed10-4e7c-a8f9-79a7098fcf25 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:09.752070 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71c4b369-ed10-4e7c-a8f9-79a7098fcf25 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:09.752887 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71c4b369-ed10-4e7c-a8f9-79a7098fcf25 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:09.753316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-71c4b369-ed10-4e7c-a8f9-79a7098fcf25 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:09.884664 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-71c4b369-ed10-4e7c-a8f9-79a7098fcf25 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:09.892384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-71c4b369-ed10-4e7c-a8f9-79a7098fcf25 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.151355 Aug 04 14:04:09.892954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 556/1140] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:09 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:10.909300 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ceb83092-0d21-44a7-9e26-a8291d8e1909 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:10.909890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ceb83092-0d21-44a7-9e26-a8291d8e1909 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:10.915872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ceb83092-0d21-44a7-9e26-a8291d8e1909 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:10.916354 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ceb83092-0d21-44a7-9e26-a8291d8e1909 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:10.917118 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ceb83092-0d21-44a7-9e26-a8291d8e1909 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:10.917548 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ceb83092-0d21-44a7-9e26-a8291d8e1909 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:11.037265 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ceb83092-0d21-44a7-9e26-a8291d8e1909 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:11.044720 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ceb83092-0d21-44a7-9e26-a8291d8e1909 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.139050 Aug 04 14:04:11.045291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 585/1141] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:10 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:12.062568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4c44945b-b1a5-42b1-a089-d631b3746bc5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:12.063134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4c44945b-b1a5-42b1-a089-d631b3746bc5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:12.069300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c44945b-b1a5-42b1-a089-d631b3746bc5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:12.069737 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c44945b-b1a5-42b1-a089-d631b3746bc5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:12.070537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c44945b-b1a5-42b1-a089-d631b3746bc5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:12.070969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4c44945b-b1a5-42b1-a089-d631b3746bc5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:12.199658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4c44945b-b1a5-42b1-a089-d631b3746bc5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:12.207020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4c44945b-b1a5-42b1-a089-d631b3746bc5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.148277 Aug 04 14:04:12.207590 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 557/1142] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:12 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:13.224477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b2e4900-339d-4f0c-bac0-20f5f6126368 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:13.225068 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b2e4900-339d-4f0c-bac0-20f5f6126368 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:13.231558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b2e4900-339d-4f0c-bac0-20f5f6126368 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:13.231999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b2e4900-339d-4f0c-bac0-20f5f6126368 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:13.232795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b2e4900-339d-4f0c-bac0-20f5f6126368 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:13.233228 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b2e4900-339d-4f0c-bac0-20f5f6126368 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:13.355209 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1b2e4900-339d-4f0c-bac0-20f5f6126368 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:13.362449 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b2e4900-339d-4f0c-bac0-20f5f6126368 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.141618 Aug 04 14:04:13.363011 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 586/1143] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:13 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:14.380350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-25b6517a-80b7-4547-8c16-9d582885ee48 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:14.381195 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-25b6517a-80b7-4547-8c16-9d582885ee48 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:14.387996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25b6517a-80b7-4547-8c16-9d582885ee48 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:14.388485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25b6517a-80b7-4547-8c16-9d582885ee48 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:14.389242 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25b6517a-80b7-4547-8c16-9d582885ee48 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:14.389762 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25b6517a-80b7-4547-8c16-9d582885ee48 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:14.519340 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-25b6517a-80b7-4547-8c16-9d582885ee48 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:14.527932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-25b6517a-80b7-4547-8c16-9d582885ee48 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1680 microversion: 2.1 time: 0.151586 Aug 04 14:04:14.528556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 558/1144] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:14 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:15.550697 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b5fcc314-bc93-434c-a2a2-fccb28a209a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:15.551301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b5fcc314-bc93-434c-a2a2-fccb28a209a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:15.557180 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b5fcc314-bc93-434c-a2a2-fccb28a209a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:15.557627 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b5fcc314-bc93-434c-a2a2-fccb28a209a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:15.558391 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b5fcc314-bc93-434c-a2a2-fccb28a209a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:15.558820 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b5fcc314-bc93-434c-a2a2-fccb28a209a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:15.677553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b5fcc314-bc93-434c-a2a2-fccb28a209a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:15.685121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b5fcc314-bc93-434c-a2a2-fccb28a209a8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1657 microversion: 2.1 time: 0.138126 Aug 04 14:04:15.685689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 587/1145] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:15 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1657 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:15.701318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4dd71661-d3f1-4168-ba78-e9c384ab5269 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:15.707050 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4dd71661-d3f1-4168-ba78-e9c384ab5269 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:15.707491 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4dd71661-d3f1-4168-ba78-e9c384ab5269 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:15.731544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4dd71661-d3f1-4168-ba78-e9c384ab5269 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Going to try to start instance {{(pid=107823) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 04 14:04:15.776493 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4dd71661-d3f1-4168-ba78-e9c384ab5269 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.078835 Aug 04 14:04:15.777573 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 559/1146] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:04:15 2021] POST /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:04:15.786686 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3a27500f-abbd-4b24-afb3-da1499a98ecf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:15.787430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3a27500f-abbd-4b24-afb3-da1499a98ecf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:15.793896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a27500f-abbd-4b24-afb3-da1499a98ecf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:15.794443 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a27500f-abbd-4b24-afb3-da1499a98ecf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:15.795339 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a27500f-abbd-4b24-afb3-da1499a98ecf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:15.795823 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a27500f-abbd-4b24-afb3-da1499a98ecf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:15.932012 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3a27500f-abbd-4b24-afb3-da1499a98ecf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:15.939597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3a27500f-abbd-4b24-afb3-da1499a98ecf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1666 microversion: 2.1 time: 0.157825 Aug 04 14:04:15.940178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 588/1147] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:15 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:16.958766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-306947a0-5da7-4381-a583-2e2dc71adc08 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:16.959465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-306947a0-5da7-4381-a583-2e2dc71adc08 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:16.966140 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-306947a0-5da7-4381-a583-2e2dc71adc08 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:16.966592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-306947a0-5da7-4381-a583-2e2dc71adc08 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:16.967373 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-306947a0-5da7-4381-a583-2e2dc71adc08 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:16.967807 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-306947a0-5da7-4381-a583-2e2dc71adc08 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:17.098718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-306947a0-5da7-4381-a583-2e2dc71adc08 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:17.105971 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-306947a0-5da7-4381-a583-2e2dc71adc08 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1666 microversion: 2.1 time: 0.151244 Aug 04 14:04:17.106601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 560/1148] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:16 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:18.123668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7fc9f3bb-cfbb-4d30-8768-e38bed1a8d3e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:18.124428 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7fc9f3bb-cfbb-4d30-8768-e38bed1a8d3e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:18.130376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fc9f3bb-cfbb-4d30-8768-e38bed1a8d3e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:18.130813 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fc9f3bb-cfbb-4d30-8768-e38bed1a8d3e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:18.131570 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fc9f3bb-cfbb-4d30-8768-e38bed1a8d3e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:18.131997 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7fc9f3bb-cfbb-4d30-8768-e38bed1a8d3e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:18.255917 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7fc9f3bb-cfbb-4d30-8768-e38bed1a8d3e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:18.263126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7fc9f3bb-cfbb-4d30-8768-e38bed1a8d3e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1670 microversion: 2.1 time: 0.143442 Aug 04 14:04:18.263691 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 589/1149] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:04:18 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1670 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:59.781413 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-827446e4-7e3c-4a25-ac0d-72e3ca166808 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:59.782041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-827446e4-7e3c-4a25-ac0d-72e3ca166808 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:59.788821 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-827446e4-7e3c-4a25-ac0d-72e3ca166808 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:59.789266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-827446e4-7e3c-4a25-ac0d-72e3ca166808 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:59.790039 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-827446e4-7e3c-4a25-ac0d-72e3ca166808 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:59.790464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-827446e4-7e3c-4a25-ac0d-72e3ca166808 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:59.819892 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-827446e4-7e3c-4a25-ac0d-72e3ca166808 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/os-volume_attachments/83ad2464-a4bd-4319-a24b-f25a17173975" status: 200 len: 194 microversion: 2.20 time: 0.042306 Aug 04 14:04:59.820507 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 561/1150] 10.222.0.43 () {60 vars in 1454 bytes} [Wed Aug 4 14:04:59 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/os-volume_attachments/83ad2464-a4bd-4319-a24b-f25a17173975 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:04:59.887665 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b7eb68a3-b297-48ff-989c-1963c1dd098c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:59.888193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b7eb68a3-b297-48ff-989c-1963c1dd098c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:04:59.894238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7eb68a3-b297-48ff-989c-1963c1dd098c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:59.894675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7eb68a3-b297-48ff-989c-1963c1dd098c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:59.895431 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7eb68a3-b297-48ff-989c-1963c1dd098c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:04:59.895853 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7eb68a3-b297-48ff-989c-1963c1dd098c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:04:59.979623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-b7eb68a3-b297-48ff-989c-1963c1dd098c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lazy-loading 'services' on Instance uuid b5a6e241-9234-4ca1-b4ca-7b90733ab705 {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:00.043407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b7eb68a3-b297-48ff-989c-1963c1dd098c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/os-volume_attachments/83ad2464-a4bd-4319-a24b-f25a17173975" status: 202 len: 0 microversion: 2.20 time: 0.159306 Aug 04 14:05:00.043923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 590/1151] 10.222.0.43 () {60 vars in 1457 bytes} [Wed Aug 4 14:04:59 2021] DELETE /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705/os-volume_attachments/83ad2464-a4bd-4319-a24b-f25a17173975 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:02.216543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-677cf4ca-3146-4c8d-9555-ab0ce6623a19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:02.217081 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-677cf4ca-3146-4c8d-9555-ab0ce6623a19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:02.223268 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-677cf4ca-3146-4c8d-9555-ab0ce6623a19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:02.223715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-677cf4ca-3146-4c8d-9555-ab0ce6623a19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:02.224572 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-677cf4ca-3146-4c8d-9555-ab0ce6623a19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:02.225665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-677cf4ca-3146-4c8d-9555-ab0ce6623a19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:02.249555 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-677cf4ca-3146-4c8d-9555-ab0ce6623a19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:05:02.322682 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-677cf4ca-3146-4c8d-9555-ab0ce6623a19 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 204 len: 0 microversion: 2.20 time: 0.109493 Aug 04 14:05:02.323538 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 562/1152] 10.222.0.43 () {60 vars in 1280 bytes} [Wed Aug 4 14:05:02 2021] DELETE /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:02.332298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:02.333028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:02.339733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:02.340175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:02.340980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:02.341413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:02.466045 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:02.473886 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:02.475541 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:02.476808 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8af6cf08-a42c-4c1c-b6e0-d7d468709511 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.148521 Aug 04 14:05:02.477385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 591/1153] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:02 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:03.496531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:03.497219 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:03.503026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:03.503462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:03.504248 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:03.504679 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:03.635439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:03.643127 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:03.644635 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:03.645754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-45689e76-b729-414e-bcb0-c42e7ce8e858 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.153871 Aug 04 14:05:03.646878 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 563/1154] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:03 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:04.663980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:04.664617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:04.670662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:04.671210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:04.672062 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:04.672593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:04.796306 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:04.804137 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:04.805653 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:04.806779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-dcef71c5-7a7f-43ec-9469-e94ceb7f0cdd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1722 microversion: 2.20 time: 0.146841 Aug 04 14:05:04.807338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 592/1155] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:04 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:05.798932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-7026852c-c34c-4f93-8a8a-674794481442 req-56fc6895-2112-47d3-9ed3-aeb4dfcca305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a6e241-9234-4ca1-b4ca-7b90733ab705", "name": "network-vif-deleted", "tag": "828cc1c2-4556-4cd2-a0e7-2ed9383548e4"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:05.800587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:05:05.800587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:05:05.808045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7026852c-c34c-4f93-8a8a-674794481442 req-56fc6895-2112-47d3-9ed3-aeb4dfcca305 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:05.808522 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7026852c-c34c-4f93-8a8a-674794481442 req-56fc6895-2112-47d3-9ed3-aeb4dfcca305 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:05.820417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-7026852c-c34c-4f93-8a8a-674794481442 req-56fc6895-2112-47d3-9ed3-aeb4dfcca305 service nova] Creating event network-vif-deleted:828cc1c2-4556-4cd2-a0e7-2ed9383548e4 for instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 on hv-cinder-79264 Aug 04 14:05:05.825659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-7026852c-c34c-4f93-8a8a-674794481442 req-56fc6895-2112-47d3-9ed3-aeb4dfcca305 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030312 Aug 04 14:05:05.826245 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 564/1156] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:05:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:05.831597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:05.832240 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:05.839141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:05.839586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:05.840599 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:05.845954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:05.925932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:05.936112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:05.937645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:05.940519 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-07a39843-3ba9-4ab2-9c7b-a2498f5f6c68 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 200 len: 1366 microversion: 2.20 time: 0.117299 Aug 04 14:05:05.941678 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 593/1157] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:05 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:06.959834 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:06.960551 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:06.966625 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:06.967068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:06.967830 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:06.968283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:06.985290 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] HTTP exception thrown: Instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 could not be found. Aug 04 14:05:06.985894 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Returning 404 to user: Instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:05:06.986710 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-adea6407-45ec-4b29-9b19-de5484f3217c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 404 len: 111 microversion: 2.20 time: 0.031262 Aug 04 14:05:06.987254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 565/1158] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:06 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:05:06.996685 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ec489717-189e-4884-9812-fab257572821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '.version_select at 0x7efe81090160>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:07.015258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ec489717-189e-4884-9812-fab257572821 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913144320" status: 204 len: 0 microversion: 2.20 time: 0.022209 Aug 04 14:05:07.015822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 594/1159] 10.222.0.43 () {60 vars in 1259 bytes} [Wed Aug 4 14:05:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913144320 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:07.675756 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-88253d37-b9fe-483d-ab98-b41852336725 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'create', calling method: .version_select at 0x7efe7c3dbd30>, body: {"keypair": {"name": "tempest-keypair-1155402758"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:07.693911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-88253d37-b9fe-483d-ab98-b41852336725 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for project 072954af44a647e3a037f30f2ac7f27b. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:05:07.697666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-88253d37-b9fe-483d-ab98-b41852336725 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for user 034d5f53aa544eb88d4522dea7b428ff and project 072954af44a647e3a037f30f2ac7f27b. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:05:07.907023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-88253d37-b9fe-483d-ab98-b41852336725 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for project 072954af44a647e3a037f30f2ac7f27b. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:05:07.910628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-88253d37-b9fe-483d-ab98-b41852336725 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for user 034d5f53aa544eb88d4522dea7b428ff and project 072954af44a647e3a037f30f2ac7f27b. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:05:07.923316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-88253d37-b9fe-483d-ab98-b41852336725 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.251384 Aug 04 14:05:07.923913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 566/1160] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Aug 4 14:05:07 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 253 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Aug 04 14:05:09.207377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1353108322", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa54aa9e-68db-4c4a-a20b-885452226b74"}], "security_groups": [{"name": "tempest-securitygroup--1047699499"}], "key_name": "tempest-keypair-1155402758", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:09.302558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] validate_networks() for [('fa54aa9e-68db-4c4a-a20b-885452226b74', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:05:09.685556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:05:09.686027 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:05:09.686501 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:05:09.686905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:05:09.687321 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:05:09.696434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:09.696875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:09.697675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:09.698107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:09.714035 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for project 072954af44a647e3a037f30f2ac7f27b. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:05:09.717921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Getting quotas for user 034d5f53aa544eb88d4522dea7b428ff and project 072954af44a647e3a037f30f2ac7f27b. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:05:09.728450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:05:09.730723 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:05:09.777790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4fefa04d-27a3-447b-b065-eae280410ac1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.574730 Aug 04 14:05:09.778604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 595/1161] 10.222.0.43 () {62 vars in 1188 bytes} [Wed Aug 4 14:05:09 2021] POST /compute/v2.1/servers => generated 402 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:05:09.789763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e15de49d-2da9-468b-9ce8-1684a4de4f29 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:09.790373 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e15de49d-2da9-468b-9ce8-1684a4de4f29 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:09.845534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e15de49d-2da9-468b-9ce8-1684a4de4f29 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:09.853531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e15de49d-2da9-468b-9ce8-1684a4de4f29 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:09.854965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e15de49d-2da9-468b-9ce8-1684a4de4f29 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:09.857040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e15de49d-2da9-468b-9ce8-1684a4de4f29 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1282 microversion: 2.20 time: 0.072657 Aug 04 14:05:09.868778 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 567/1162] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:09 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:05:10.877502 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:10.878111 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:10.886172 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:10.886621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:10.887395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:10.887823 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:10.951999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:10.960506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:10.962016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:10.963101 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-12866821-cfa1-4d6d-9bc6-5d6839def417 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1352 microversion: 2.20 time: 0.091671 Aug 04 14:05:10.963659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 596/1163] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:10 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:11.981827 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:11.982624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:11.988962 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:11.989579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:11.990626 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:11.991193 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:12.186676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-833669ac-cd46-4d6f-9848-3970402a051a req-1ff3bfc2-b405-48e2-bf36-d9a60e9c2d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71864169-d3ea-45e4-8e11-0a36283b817c", "tag": "83351cb5-e13b-4211-b517-59a303fca918"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:12.189126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:05:12.189126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:05:12.199827 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-833669ac-cd46-4d6f-9848-3970402a051a req-1ff3bfc2-b405-48e2-bf36-d9a60e9c2d69 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:12.200594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-833669ac-cd46-4d6f-9848-3970402a051a req-1ff3bfc2-b405-48e2-bf36-d9a60e9c2d69 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:12.221460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:12.238621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:12.241381 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:12.243084 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8c88f552-f55d-4d73-a85a-c1dfc776775a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.265423 Aug 04 14:05:12.244390 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 568/1164] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:11 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:12.258857 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-833669ac-cd46-4d6f-9848-3970402a051a req-1ff3bfc2-b405-48e2-bf36-d9a60e9c2d69 service nova] Creating event network-changed:83351cb5-e13b-4211-b517-59a303fca918 for instance 71864169-d3ea-45e4-8e11-0a36283b817c on hv-cinder-79264 Aug 04 14:05:12.264580 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-833669ac-cd46-4d6f-9848-3970402a051a req-1ff3bfc2-b405-48e2-bf36-d9a60e9c2d69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081747 Aug 04 14:05:12.265267 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 597/1165] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:05:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:05:13.267162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:13.267849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:13.274021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:13.274471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:13.275322 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:13.275755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:13.397969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:13.405967 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:13.407470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:13.408585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e34a5dbf-cd9f-4422-bb17-46cc627f5246 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.145391 Aug 04 14:05:13.409148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 569/1166] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:13 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:14.427236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:14.428014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:14.433933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:14.434373 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:14.435127 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:14.435554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:14.562214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:14.570306 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:14.571828 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:14.572963 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f7e5169d-34eb-4717-9a8d-16b5aacf2e1b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.149804 Aug 04 14:05:14.573797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 598/1167] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:14 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:15.591063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:15.591605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:15.597469 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:15.597916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:15.598684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:15.599128 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:15.726954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:15.734702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:15.736182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:15.737279 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d0c5252d-853a-4e2f-8c2a-5af9e2bf6b3a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.150248 Aug 04 14:05:15.737835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 570/1168] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:15 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:16.754810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:16.755448 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:16.761573 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:16.762014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:16.762775 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:16.763239 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:16.885496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:16.893561 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:16.895079 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:16.896383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f736e619-c02b-46d2-983d-d3ab6e4222ff tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.145086 Aug 04 14:05:16.897301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 599/1169] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:16 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:17.914187 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:17.914779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:17.920598 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:17.921037 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:17.921789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:17.922208 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:18.046988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:18.057189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:18.058856 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:18.060116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b93ecff3-1441-41ea-9505-cbe53e096571 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.149668 Aug 04 14:05:18.061209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 571/1170] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:17 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:19.080130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:19.080763 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:19.089236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:19.090198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:19.091003 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:19.091438 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:19.221098 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:19.233826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:19.235313 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:19.236440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ca33f8a3-180f-4065-9658-c57a4d3eb4bc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.160048 Aug 04 14:05:19.236999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 600/1171] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:19 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:19.383625 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-26d41b8f-531c-4574-b4f0-36da04e90187 req-71854589-d3b6-4e52-b618-e1aa194e45da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71864169-d3ea-45e4-8e11-0a36283b817c", "name": "network-vif-plugged", "status": "completed", "tag": "83351cb5-e13b-4211-b517-59a303fca918"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:19.385211 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:05:19.385211 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:05:19.392005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-26d41b8f-531c-4574-b4f0-36da04e90187 req-71854589-d3b6-4e52-b618-e1aa194e45da service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:19.392484 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-26d41b8f-531c-4574-b4f0-36da04e90187 req-71854589-d3b6-4e52-b618-e1aa194e45da service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:19.403756 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-26d41b8f-531c-4574-b4f0-36da04e90187 req-71854589-d3b6-4e52-b618-e1aa194e45da service nova] Creating event network-vif-plugged:83351cb5-e13b-4211-b517-59a303fca918 for instance 71864169-d3ea-45e4-8e11-0a36283b817c on hv-cinder-79264 Aug 04 14:05:19.408531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-26d41b8f-531c-4574-b4f0-36da04e90187 req-71854589-d3b6-4e52-b618-e1aa194e45da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029306 Aug 04 14:05:19.409233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 572/1172] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:05:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:20.254821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:20.255456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:20.261378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:20.261822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:20.262583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:20.263013 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:20.392799 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:20.401514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:20.403001 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:20.404074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ebf2dc4d-0acc-42bf-8368-6aa23ba29132 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.153028 Aug 04 14:05:20.404656 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 601/1173] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:20 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:21.422733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:21.423476 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:21.431326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:21.431772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:21.432654 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:21.433223 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:21.565076 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:21.572776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:21.574527 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:21.575593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3fde1794-3d74-44fb-ba49-deeb25de47c8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1408 microversion: 2.20 time: 0.157037 Aug 04 14:05:21.576146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 573/1174] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:21 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:22.593741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:22.594426 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:22.600685 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:22.601128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:22.601895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:22.602401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:22.724465 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:22.732179 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:22.733682 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:22.734800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b1a908e5-f27a-4153-b14e-dd4eea29ca86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1600 microversion: 2.20 time: 0.144818 Aug 04 14:05:22.735351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 602/1175] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:05:22 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:22.752247 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cca3c78d-9f67-4561-bd88-f798950b86f3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:22.752749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cca3c78d-9f67-4561-bd88-f798950b86f3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:22.758945 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cca3c78d-9f67-4561-bd88-f798950b86f3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:22.759394 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cca3c78d-9f67-4561-bd88-f798950b86f3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:22.760147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cca3c78d-9f67-4561-bd88-f798950b86f3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:22.760603 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cca3c78d-9f67-4561-bd88-f798950b86f3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:22.837778 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cca3c78d-9f67-4561-bd88-f798950b86f3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089174 Aug 04 14:05:22.838407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 574/1176] 10.222.0.43 () {60 vars in 1316 bytes} [Wed Aug 4 14:05:22 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:05:23.816136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-10f0e508-f2ea-4d33-912f-d81bfdad2a77 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:23.817263 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-10f0e508-f2ea-4d33-912f-d81bfdad2a77 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:23.819011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-7ce90327-c74e-402f-b8dc-0af166ef9303 req-19d25a03-fd2d-4680-8d45-1beec05c8681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71864169-d3ea-45e4-8e11-0a36283b817c", "tag": "83351cb5-e13b-4211-b517-59a303fca918"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:23.820819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:05:23.820819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:05:23.824028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-10f0e508-f2ea-4d33-912f-d81bfdad2a77 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:23.824518 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-10f0e508-f2ea-4d33-912f-d81bfdad2a77 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:23.825291 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-10f0e508-f2ea-4d33-912f-d81bfdad2a77 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:23.825942 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-10f0e508-f2ea-4d33-912f-d81bfdad2a77 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:23.828528 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7ce90327-c74e-402f-b8dc-0af166ef9303 req-19d25a03-fd2d-4680-8d45-1beec05c8681 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:23.828923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7ce90327-c74e-402f-b8dc-0af166ef9303 req-19d25a03-fd2d-4680-8d45-1beec05c8681 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:23.841173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-7ce90327-c74e-402f-b8dc-0af166ef9303 req-19d25a03-fd2d-4680-8d45-1beec05c8681 service nova] Creating event network-changed:83351cb5-e13b-4211-b517-59a303fca918 for instance 71864169-d3ea-45e4-8e11-0a36283b817c on hv-cinder-79264 Aug 04 14:05:23.846440 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-7ce90327-c74e-402f-b8dc-0af166ef9303 req-19d25a03-fd2d-4680-8d45-1beec05c8681 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031396 Aug 04 14:05:23.847274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 575/1177] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:05:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:23.943161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-10f0e508-f2ea-4d33-912f-d81bfdad2a77 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.129950 Aug 04 14:05:23.946546 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 603/1178] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:23 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:24.955283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4bd5528f-885a-4eda-9cb7-36d4d9a65fb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:24.956308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4bd5528f-885a-4eda-9cb7-36d4d9a65fb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:24.962347 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bd5528f-885a-4eda-9cb7-36d4d9a65fb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:24.962797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bd5528f-885a-4eda-9cb7-36d4d9a65fb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:24.963658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bd5528f-885a-4eda-9cb7-36d4d9a65fb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:24.964093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4bd5528f-885a-4eda-9cb7-36d4d9a65fb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:25.050641 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4bd5528f-885a-4eda-9cb7-36d4d9a65fb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.099426 Aug 04 14:05:25.054390 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 576/1179] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:24 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:26.062829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cd0b619c-8592-436e-a668-ce840aacc31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:26.063822 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cd0b619c-8592-436e-a668-ce840aacc31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:26.071047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd0b619c-8592-436e-a668-ce840aacc31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:26.071497 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd0b619c-8592-436e-a668-ce840aacc31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:26.072405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd0b619c-8592-436e-a668-ce840aacc31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:26.072750 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cd0b619c-8592-436e-a668-ce840aacc31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:26.165536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cd0b619c-8592-436e-a668-ce840aacc31e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.106500 Aug 04 14:05:26.166191 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 604/1180] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:26 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:27.176494 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c1cb8471-b0e7-4922-a7a1-c8a99fb21abc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:27.177533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c1cb8471-b0e7-4922-a7a1-c8a99fb21abc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:27.184172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c1cb8471-b0e7-4922-a7a1-c8a99fb21abc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:27.184662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c1cb8471-b0e7-4922-a7a1-c8a99fb21abc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:27.185441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c1cb8471-b0e7-4922-a7a1-c8a99fb21abc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:27.185871 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c1cb8471-b0e7-4922-a7a1-c8a99fb21abc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:27.304154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c1cb8471-b0e7-4922-a7a1-c8a99fb21abc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.131666 Aug 04 14:05:27.304861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 577/1181] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:27 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:28.315571 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fe349cac-ab7b-4561-b271-ed151921d785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:28.316588 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fe349cac-ab7b-4561-b271-ed151921d785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:28.323907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fe349cac-ab7b-4561-b271-ed151921d785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:28.324390 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fe349cac-ab7b-4561-b271-ed151921d785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:28.325169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fe349cac-ab7b-4561-b271-ed151921d785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:28.325605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fe349cac-ab7b-4561-b271-ed151921d785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:28.440151 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fe349cac-ab7b-4561-b271-ed151921d785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.128531 Aug 04 14:05:28.440849 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 605/1182] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:28 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:29.452500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-34c74284-eb5b-4f5e-9156-85c8ec357c79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:29.453503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-34c74284-eb5b-4f5e-9156-85c8ec357c79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:29.461814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-34c74284-eb5b-4f5e-9156-85c8ec357c79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:29.462255 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-34c74284-eb5b-4f5e-9156-85c8ec357c79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:29.463059 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-34c74284-eb5b-4f5e-9156-85c8ec357c79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:29.463456 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-34c74284-eb5b-4f5e-9156-85c8ec357c79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:29.564566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-34c74284-eb5b-4f5e-9156-85c8ec357c79 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.116289 Aug 04 14:05:29.565203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 578/1183] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:29 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:30.576471 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6d6daa3b-b50f-4739-ba50-1e759e06c2c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:30.577487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6d6daa3b-b50f-4739-ba50-1e759e06c2c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:30.584464 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d6daa3b-b50f-4739-ba50-1e759e06c2c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:30.584901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d6daa3b-b50f-4739-ba50-1e759e06c2c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:30.585770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d6daa3b-b50f-4739-ba50-1e759e06c2c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:30.586362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d6daa3b-b50f-4739-ba50-1e759e06c2c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:30.686860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6d6daa3b-b50f-4739-ba50-1e759e06c2c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.114502 Aug 04 14:05:30.687398 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 606/1184] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:30 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:31.699487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-459098b4-6ca8-490f-9d4f-5d1d6bf799a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:31.700444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-459098b4-6ca8-490f-9d4f-5d1d6bf799a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:31.706918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-459098b4-6ca8-490f-9d4f-5d1d6bf799a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:31.707368 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-459098b4-6ca8-490f-9d4f-5d1d6bf799a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:31.708849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-459098b4-6ca8-490f-9d4f-5d1d6bf799a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:31.709298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-459098b4-6ca8-490f-9d4f-5d1d6bf799a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:31.812753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-459098b4-6ca8-490f-9d4f-5d1d6bf799a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.117531 Aug 04 14:05:31.813382 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 579/1185] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:31 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:32.823600 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c4cc0e2a-7474-4257-b91f-643a4cb4912b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:32.824617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c4cc0e2a-7474-4257-b91f-643a4cb4912b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:32.831012 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4cc0e2a-7474-4257-b91f-643a4cb4912b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:32.831455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4cc0e2a-7474-4257-b91f-643a4cb4912b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:32.832233 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4cc0e2a-7474-4257-b91f-643a4cb4912b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:32.832673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c4cc0e2a-7474-4257-b91f-643a4cb4912b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:32.920019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c4cc0e2a-7474-4257-b91f-643a4cb4912b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.100530 Aug 04 14:05:32.920696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 607/1186] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:32 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:33.931512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cc3aebeb-630e-4b66-a907-707e907b9803 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:33.932574 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cc3aebeb-630e-4b66-a907-707e907b9803 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:33.939039 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cc3aebeb-630e-4b66-a907-707e907b9803 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:33.939487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cc3aebeb-630e-4b66-a907-707e907b9803 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:33.940290 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cc3aebeb-630e-4b66-a907-707e907b9803 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:33.940725 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cc3aebeb-630e-4b66-a907-707e907b9803 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:34.034483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cc3aebeb-630e-4b66-a907-707e907b9803 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.106816 Aug 04 14:05:34.035114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 580/1187] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:33 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:34.955456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1dfc3161-24cf-4304-8e0c-7c422ff830b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:34.956043 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1dfc3161-24cf-4304-8e0c-7c422ff830b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:34.962797 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1dfc3161-24cf-4304-8e0c-7c422ff830b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:34.963244 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1dfc3161-24cf-4304-8e0c-7c422ff830b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:34.964010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1dfc3161-24cf-4304-8e0c-7c422ff830b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:34.964469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1dfc3161-24cf-4304-8e0c-7c422ff830b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:34.988581 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1dfc3161-24cf-4304-8e0c-7c422ff830b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Going to try to terminate instance {{(pid=107822) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:05:35.045792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ddeb4293-7c78-4345-9ec4-2b94d3ced8a5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:35.046782 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ddeb4293-7c78-4345-9ec4-2b94d3ced8a5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:35.053304 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ddeb4293-7c78-4345-9ec4-2b94d3ced8a5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:35.053741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ddeb4293-7c78-4345-9ec4-2b94d3ced8a5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:35.054517 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ddeb4293-7c78-4345-9ec4-2b94d3ced8a5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:35.054949 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ddeb4293-7c78-4345-9ec4-2b94d3ced8a5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:35.062130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1dfc3161-24cf-4304-8e0c-7c422ff830b5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 204 len: 0 microversion: 2.1 time: 0.110362 Aug 04 14:05:35.063019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 608/1188] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:05:34 2021] DELETE /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:35.071470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8985d664-f6f1-4e19-ba0e-ecb9f6e7a8db tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:35.072143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8985d664-f6f1-4e19-ba0e-ecb9f6e7a8db tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:35.078260 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8985d664-f6f1-4e19-ba0e-ecb9f6e7a8db tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:35.078708 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8985d664-f6f1-4e19-ba0e-ecb9f6e7a8db tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:35.079553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8985d664-f6f1-4e19-ba0e-ecb9f6e7a8db tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:35.079920 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8985d664-f6f1-4e19-ba0e-ecb9f6e7a8db tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:35.206676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8985d664-f6f1-4e19-ba0e-ecb9f6e7a8db tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:35.209413 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ddeb4293-7c78-4345-9ec4-2b94d3ced8a5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 14 microversion: 2.20 time: 0.167377 Aug 04 14:05:35.212742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 581/1189] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:35 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:35.215214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8985d664-f6f1-4e19-ba0e-ecb9f6e7a8db tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1676 microversion: 2.1 time: 0.147871 Aug 04 14:05:35.215773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 609/1190] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:35 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:36.220870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f092e4c4-5789-40f6-8e4d-2bedf0b06cb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:36.221974 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f092e4c4-5789-40f6-8e4d-2bedf0b06cb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:36.228648 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f092e4c4-5789-40f6-8e4d-2bedf0b06cb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:36.229092 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f092e4c4-5789-40f6-8e4d-2bedf0b06cb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:36.229864 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f092e4c4-5789-40f6-8e4d-2bedf0b06cb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:36.230292 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f092e4c4-5789-40f6-8e4d-2bedf0b06cb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:36.232927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8f64d5b1-81f3-48d2-ab97-a3c3ce4a46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:36.233526 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8f64d5b1-81f3-48d2-ab97-a3c3ce4a46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:36.240876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f64d5b1-81f3-48d2-ab97-a3c3ce4a46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:36.241316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f64d5b1-81f3-48d2-ab97-a3c3ce4a46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:36.242087 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f64d5b1-81f3-48d2-ab97-a3c3ce4a46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:36.242512 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8f64d5b1-81f3-48d2-ab97-a3c3ce4a46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:36.336858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f092e4c4-5789-40f6-8e4d-2bedf0b06cb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 10009 microversion: 2.20 time: 0.119912 Aug 04 14:05:36.337622 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 582/1191] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:36 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 10009 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:36.369914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-8f64d5b1-81f3-48d2-ab97-a3c3ce4a46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:36.377428 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8f64d5b1-81f3-48d2-ab97-a3c3ce4a46a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1676 microversion: 2.1 time: 0.148081 Aug 04 14:05:36.378005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 610/1192] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:36 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:37.350114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-85c3e6e8-c279-42da-955a-0dbf1d5dba62 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:37.351152 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-85c3e6e8-c279-42da-955a-0dbf1d5dba62 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:37.358878 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-85c3e6e8-c279-42da-955a-0dbf1d5dba62 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.359324 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-85c3e6e8-c279-42da-955a-0dbf1d5dba62 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.360113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-85c3e6e8-c279-42da-955a-0dbf1d5dba62 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.360927 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-85c3e6e8-c279-42da-955a-0dbf1d5dba62 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.397443 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b82f40ae-eb36-48bc-9a3d-c40faab2b09e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:37.398194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b82f40ae-eb36-48bc-9a3d-c40faab2b09e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:37.404666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b82f40ae-eb36-48bc-9a3d-c40faab2b09e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.405117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b82f40ae-eb36-48bc-9a3d-c40faab2b09e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.406261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b82f40ae-eb36-48bc-9a3d-c40faab2b09e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.406700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b82f40ae-eb36-48bc-9a3d-c40faab2b09e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.459688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-85c3e6e8-c279-42da-955a-0dbf1d5dba62 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 16364 microversion: 2.20 time: 0.113437 Aug 04 14:05:37.460735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 583/1193] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:37 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 16364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:37.486654 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b82f40ae-eb36-48bc-9a3d-c40faab2b09e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:37.497455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b82f40ae-eb36-48bc-9a3d-c40faab2b09e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1608 microversion: 2.1 time: 0.103481 Aug 04 14:05:37.499018 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 611/1194] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:37 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:37.516727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-69bd52db-21b6-4efc-af66-0e49ecba1838 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:37.517754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-69bd52db-21b6-4efc-af66-0e49ecba1838 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:37.525071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69bd52db-21b6-4efc-af66-0e49ecba1838 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.525519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69bd52db-21b6-4efc-af66-0e49ecba1838 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.526297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69bd52db-21b6-4efc-af66-0e49ecba1838 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.526732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-69bd52db-21b6-4efc-af66-0e49ecba1838 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.613613 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-69bd52db-21b6-4efc-af66-0e49ecba1838 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "POST /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/action" status: 202 len: 0 microversion: 2.1 time: 0.100779 Aug 04 14:05:37.614353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 584/1195] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:05:37 2021] POST /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:37.622477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d0785e67-1890-496e-96fd-1de46ac6a22d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:37.622995 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d0785e67-1890-496e-96fd-1de46ac6a22d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:37.629456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0785e67-1890-496e-96fd-1de46ac6a22d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.630798 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0785e67-1890-496e-96fd-1de46ac6a22d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.632830 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0785e67-1890-496e-96fd-1de46ac6a22d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.633803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0785e67-1890-496e-96fd-1de46ac6a22d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.800305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d0785e67-1890-496e-96fd-1de46ac6a22d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:37.810159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d0785e67-1890-496e-96fd-1de46ac6a22d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1753 microversion: 2.1 time: 0.191495 Aug 04 14:05:37.813726 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-7e00781a-b79d-4d16-ac11-8a106bd9e62f req-870fe737-37fb-4682-af0d-2e260c2bd749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1349a3-e392-480b-84ed-d851137f5a0c", "name": "network-vif-deleted", "tag": "c35367a7-2079-4165-ae77-a51b6092b849"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:37.815243 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:05:37.815243 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:05:37.823154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 612/1196] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:37 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:37.827369 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7e00781a-b79d-4d16-ac11-8a106bd9e62f req-870fe737-37fb-4682-af0d-2e260c2bd749 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:37.827807 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-7e00781a-b79d-4d16-ac11-8a106bd9e62f req-870fe737-37fb-4682-af0d-2e260c2bd749 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:37.843163 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-7e00781a-b79d-4d16-ac11-8a106bd9e62f req-870fe737-37fb-4682-af0d-2e260c2bd749 service nova] Creating event network-vif-deleted:c35367a7-2079-4165-ae77-a51b6092b849 for instance 2c1349a3-e392-480b-84ed-d851137f5a0c on hv-cinder-79264 Aug 04 14:05:37.852106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-7e00781a-b79d-4d16-ac11-8a106bd9e62f req-870fe737-37fb-4682-af0d-2e260c2bd749 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043446 Aug 04 14:05:37.854474 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 585/1197] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:05:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:38.471105 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ec2a7bcc-62b1-4ca0-9c82-93c832ee5f4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:38.472106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ec2a7bcc-62b1-4ca0-9c82-93c832ee5f4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:38.479019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ec2a7bcc-62b1-4ca0-9c82-93c832ee5f4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:38.479475 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ec2a7bcc-62b1-4ca0-9c82-93c832ee5f4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:38.481019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ec2a7bcc-62b1-4ca0-9c82-93c832ee5f4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:38.481432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ec2a7bcc-62b1-4ca0-9c82-93c832ee5f4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:38.515729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:38.517260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:38.525035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:38.525481 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:38.526487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:38.527343 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:38.562587 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:38.563056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:38.563510 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lazy-loading 'fault' on Instance uuid 2c1349a3-e392-480b-84ed-d851137f5a0c {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:38.586610 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ec2a7bcc-62b1-4ca0-9c82-93c832ee5f4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 18356 microversion: 2.20 time: 0.118609 Aug 04 14:05:38.591676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 613/1198] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:38 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 18356 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:38.618669 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:38.626844 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3d059a9e-4d2b-4f5d-acb0-6c5e146f5bc1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 200 len: 1328 microversion: 2.1 time: 0.115069 Aug 04 14:05:38.627794 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 586/1199] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:38 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:38.829699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4c07a425-fe9d-429a-bf12-c97a713b14fa tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:38.830706 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4c07a425-fe9d-429a-bf12-c97a713b14fa tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:38.838502 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c07a425-fe9d-429a-bf12-c97a713b14fa tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:38.839274 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c07a425-fe9d-429a-bf12-c97a713b14fa tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:38.840161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c07a425-fe9d-429a-bf12-c97a713b14fa tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:38.840811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c07a425-fe9d-429a-bf12-c97a713b14fa tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:38.982156 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4c07a425-fe9d-429a-bf12-c97a713b14fa tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:38.997426 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4c07a425-fe9d-429a-bf12-c97a713b14fa tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.168505 Aug 04 14:05:38.998057 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 614/1200] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:38 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:39.599610 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-43010d0d-51a4-45d4-b85a-e646a70ff014 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:39.600561 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-43010d0d-51a4-45d4-b85a-e646a70ff014 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:39.606365 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-43010d0d-51a4-45d4-b85a-e646a70ff014 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:39.606807 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-43010d0d-51a4-45d4-b85a-e646a70ff014 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:39.607565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-43010d0d-51a4-45d4-b85a-e646a70ff014 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:39.607991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-43010d0d-51a4-45d4-b85a-e646a70ff014 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:39.646091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:39.646986 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:39.653004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:39.653440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:39.654230 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:39.654663 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:39.670174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] HTTP exception thrown: Instance 2c1349a3-e392-480b-84ed-d851137f5a0c could not be found. Aug 04 14:05:39.670905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Returning 404 to user: Instance 2c1349a3-e392-480b-84ed-d851137f5a0c could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:05:39.671590 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-82699f04-3d50-4df5-bfe6-717a13b2dc0f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 404 len: 111 microversion: 2.1 time: 0.030082 Aug 04 14:05:39.672375 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 615/1201] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:39 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:05:39.680510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8539ab0d-117c-4212-aff6-45c09165dc51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '.version_select at 0x7efe8119f0d0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:39.710983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8539ab0d-117c-4212-aff6-45c09165dc51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381021727" status: 202 len: 0 microversion: 2.1 time: 0.034071 Aug 04 14:05:39.711483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 616/1202] 10.222.0.43 () {58 vars in 1221 bytes} [Wed Aug 4 14:05:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381021727 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:05:39.714178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-43010d0d-51a4-45d4-b85a-e646a70ff014 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 19399 microversion: 2.20 time: 0.119032 Aug 04 14:05:39.715052 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 587/1203] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:39 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 19399 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:40.016424 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4f8442cf-c265-417a-b7f2-d9d2ad42d3dc tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:40.017030 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4f8442cf-c265-417a-b7f2-d9d2ad42d3dc tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:40.023734 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f8442cf-c265-417a-b7f2-d9d2ad42d3dc tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:40.024293 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f8442cf-c265-417a-b7f2-d9d2ad42d3dc tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:40.024982 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f8442cf-c265-417a-b7f2-d9d2ad42d3dc tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:40.025498 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4f8442cf-c265-417a-b7f2-d9d2ad42d3dc tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:40.174483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4f8442cf-c265-417a-b7f2-d9d2ad42d3dc tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:40.185220 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4f8442cf-c265-417a-b7f2-d9d2ad42d3dc tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.172935 Aug 04 14:05:40.185796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 617/1204] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:40 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:40.403201 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7a3999e1-a547-4fea-8767-daae8431b3e5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'create', calling method: .version_select at 0x7efe7c3ac9d0>, body: {"keypair": {"name": "tempest-keypair-495854005"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:40.421032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-7a3999e1-a547-4fea-8767-daae8431b3e5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:05:40.424615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-7a3999e1-a547-4fea-8767-daae8431b3e5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for user b9c2439b760c4abaa9cd6a43408bf092 and project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:05:40.606855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-7a3999e1-a547-4fea-8767-daae8431b3e5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:05:40.610448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-7a3999e1-a547-4fea-8767-daae8431b3e5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for user b9c2439b760c4abaa9cd6a43408bf092 and project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:05:40.623462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7a3999e1-a547-4fea-8767-daae8431b3e5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.224402 Aug 04 14:05:40.623987 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 588/1205] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Aug 4 14:05:40 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:40.725766 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8e59d942-6a17-4db9-a854-40c4219a0e96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:40.727172 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8e59d942-6a17-4db9-a854-40c4219a0e96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:40.733100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e59d942-6a17-4db9-a854-40c4219a0e96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:40.733539 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e59d942-6a17-4db9-a854-40c4219a0e96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:40.734304 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e59d942-6a17-4db9-a854-40c4219a0e96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:40.734731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e59d942-6a17-4db9-a854-40c4219a0e96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:40.837800 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8e59d942-6a17-4db9-a854-40c4219a0e96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 22440 microversion: 2.20 time: 0.116008 Aug 04 14:05:40.841768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 618/1206] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:40 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 22440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:41.205028 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4714f32a-5437-41e9-945c-c0780bac28d7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:41.206005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4714f32a-5437-41e9-945c-c0780bac28d7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:41.212717 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4714f32a-5437-41e9-945c-c0780bac28d7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:41.213181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4714f32a-5437-41e9-945c-c0780bac28d7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:41.214188 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4714f32a-5437-41e9-945c-c0780bac28d7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:41.214650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4714f32a-5437-41e9-945c-c0780bac28d7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:41.432748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4714f32a-5437-41e9-945c-c0780bac28d7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:41.440682 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4714f32a-5437-41e9-945c-c0780bac28d7 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.240446 Aug 04 14:05:41.441329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 589/1207] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:41 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:41.850572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7f3d1c1a-1543-4cbd-988b-3faeaa8226d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:41.851703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7f3d1c1a-1543-4cbd-988b-3faeaa8226d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:41.858698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f3d1c1a-1543-4cbd-988b-3faeaa8226d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:41.859152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f3d1c1a-1543-4cbd-988b-3faeaa8226d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:41.859918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f3d1c1a-1543-4cbd-988b-3faeaa8226d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:41.860374 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f3d1c1a-1543-4cbd-988b-3faeaa8226d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:41.951740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1980669020", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0081e9f6-4973-4c5d-a223-86c0d7d78ed7"}], "security_groups": [{"name": "tempest-securitygroup--1977452090"}], "key_name": "tempest-keypair-495854005", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:41.963045 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7f3d1c1a-1543-4cbd-988b-3faeaa8226d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 23804 microversion: 2.20 time: 0.117225 Aug 04 14:05:41.963864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 619/1208] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:41 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 23804 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:42.047319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] validate_networks() for [('0081e9f6-4973-4c5d-a223-86c0d7d78ed7', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:05:42.426336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:05:42.428018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:05:42.428512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:05:42.428918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:05:42.429319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:05:42.437634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:42.438065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:42.438847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:42.439274 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:42.456336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:05:42.459126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d2bcd741-ff87-42ae-9c61-f6227fdf6fd0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:42.459829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d2bcd741-ff87-42ae-9c61-f6227fdf6fd0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:42.461414 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Getting quotas for user b9c2439b760c4abaa9cd6a43408bf092 and project fdd1f57702c84fa0a573ef2d56077e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:05:42.466376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d2bcd741-ff87-42ae-9c61-f6227fdf6fd0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:42.466824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d2bcd741-ff87-42ae-9c61-f6227fdf6fd0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:42.467598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d2bcd741-ff87-42ae-9c61-f6227fdf6fd0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:42.468031 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d2bcd741-ff87-42ae-9c61-f6227fdf6fd0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:42.475588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:05:42.477930 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:05:42.526059 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-854e8df2-d32e-4aa4-88e4-b96cb9a6ae74 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.578588 Aug 04 14:05:42.526915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 590/1209] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:05:41 2021] POST /compute/v2.1/servers => generated 402 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:05:42.538754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0501a781-74a5-4f8c-9b9e-e2c13d9ab1f5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:42.539702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0501a781-74a5-4f8c-9b9e-e2c13d9ab1f5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:42.595557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0501a781-74a5-4f8c-9b9e-e2c13d9ab1f5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:42.600268 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d2bcd741-ff87-42ae-9c61-f6227fdf6fd0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:42.602875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0501a781-74a5-4f8c-9b9e-e2c13d9ab1f5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1237 microversion: 2.1 time: 0.069117 Aug 04 14:05:42.612791 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 591/1210] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:42 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:42.612910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d2bcd741-ff87-42ae-9c61-f6227fdf6fd0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.153768 Aug 04 14:05:42.612910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 620/1211] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:42 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:42.973913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a04089cd-6b05-4bd5-81b2-f05e18b2ec51 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:42.974882 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a04089cd-6b05-4bd5-81b2-f05e18b2ec51 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:42.981394 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a04089cd-6b05-4bd5-81b2-f05e18b2ec51 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:42.981833 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a04089cd-6b05-4bd5-81b2-f05e18b2ec51 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:42.982586 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a04089cd-6b05-4bd5-81b2-f05e18b2ec51 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:42.983008 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a04089cd-6b05-4bd5-81b2-f05e18b2ec51 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:43.082241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a04089cd-6b05-4bd5-81b2-f05e18b2ec51 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 25104 microversion: 2.20 time: 0.111932 Aug 04 14:05:43.082925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 592/1212] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:42 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 25104 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:43.620773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-145a6d8c-b3b0-43dd-a9ea-a6db9eb86f07 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:43.621933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-145a6d8c-b3b0-43dd-a9ea-a6db9eb86f07 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:43.627692 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-eecc944d-0bfc-4f40-93d8-7cb63c64909f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:43.628532 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-eecc944d-0bfc-4f40-93d8-7cb63c64909f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:43.645818 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eecc944d-0bfc-4f40-93d8-7cb63c64909f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:43.646432 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eecc944d-0bfc-4f40-93d8-7cb63c64909f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:43.647227 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eecc944d-0bfc-4f40-93d8-7cb63c64909f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:43.647651 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-eecc944d-0bfc-4f40-93d8-7cb63c64909f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:43.701388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-145a6d8c-b3b0-43dd-a9ea-a6db9eb86f07 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:43.708341 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-145a6d8c-b3b0-43dd-a9ea-a6db9eb86f07 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1237 microversion: 2.1 time: 0.091222 Aug 04 14:05:43.709219 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 621/1213] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:43 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:43.803160 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-eecc944d-0bfc-4f40-93d8-7cb63c64909f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:43.812124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-eecc944d-0bfc-4f40-93d8-7cb63c64909f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.188820 Aug 04 14:05:43.812902 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 593/1214] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:43 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:44.094844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1a6f482a-4b6e-4a15-b645-900413c09d7b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:44.095791 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1a6f482a-4b6e-4a15-b645-900413c09d7b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:44.103383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a6f482a-4b6e-4a15-b645-900413c09d7b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:44.103830 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a6f482a-4b6e-4a15-b645-900413c09d7b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:44.104641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a6f482a-4b6e-4a15-b645-900413c09d7b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:44.105069 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a6f482a-4b6e-4a15-b645-900413c09d7b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:44.204474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1a6f482a-4b6e-4a15-b645-900413c09d7b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 26526 microversion: 2.20 time: 0.113446 Aug 04 14:05:44.205122 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 622/1215] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:44 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 26526 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:44.725153 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3d266542-02b0-444c-8169-952f9bc327ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:44.725769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3d266542-02b0-444c-8169-952f9bc327ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:44.777749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3d266542-02b0-444c-8169-952f9bc327ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:44.785271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3d266542-02b0-444c-8169-952f9bc327ae tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1237 microversion: 2.1 time: 0.063859 Aug 04 14:05:44.785881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 594/1216] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:44 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:44.830565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-826db817-1317-40c7-9838-a23489c06151 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:44.831258 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-826db817-1317-40c7-9838-a23489c06151 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:44.837739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-826db817-1317-40c7-9838-a23489c06151 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:44.838178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-826db817-1317-40c7-9838-a23489c06151 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:44.838941 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-826db817-1317-40c7-9838-a23489c06151 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:44.839367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-826db817-1317-40c7-9838-a23489c06151 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:44.966954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-826db817-1317-40c7-9838-a23489c06151 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:44.975123 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-826db817-1317-40c7-9838-a23489c06151 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.148636 Aug 04 14:05:44.975747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 623/1217] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:44 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:45.216612 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4488e922-8c8e-45e4-863c-8edbf4893100 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:45.217535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4488e922-8c8e-45e4-863c-8edbf4893100 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:45.224576 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4488e922-8c8e-45e4-863c-8edbf4893100 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:45.225058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4488e922-8c8e-45e4-863c-8edbf4893100 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:45.225889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4488e922-8c8e-45e4-863c-8edbf4893100 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:45.226266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4488e922-8c8e-45e4-863c-8edbf4893100 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:45.354301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4488e922-8c8e-45e4-863c-8edbf4893100 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 27634 microversion: 2.20 time: 0.141189 Aug 04 14:05:45.355326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 595/1218] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:45 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 27634 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:45.804063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f03e5691-aac2-4c48-b8a2-8ba150bed96f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:45.804582 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f03e5691-aac2-4c48-b8a2-8ba150bed96f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:45.810788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f03e5691-aac2-4c48-b8a2-8ba150bed96f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:45.811235 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f03e5691-aac2-4c48-b8a2-8ba150bed96f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:45.812017 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f03e5691-aac2-4c48-b8a2-8ba150bed96f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:45.812473 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f03e5691-aac2-4c48-b8a2-8ba150bed96f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:45.916075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f03e5691-aac2-4c48-b8a2-8ba150bed96f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:45.926103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f03e5691-aac2-4c48-b8a2-8ba150bed96f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1297 microversion: 2.1 time: 0.127006 Aug 04 14:05:45.927054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 624/1219] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:45 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1297 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:45.995001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-dc48db43-fe07-4542-890b-c94c7e29602f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:45.995701 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-dc48db43-fe07-4542-890b-c94c7e29602f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:46.005931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc48db43-fe07-4542-890b-c94c7e29602f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:46.006533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc48db43-fe07-4542-890b-c94c7e29602f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:46.007486 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc48db43-fe07-4542-890b-c94c7e29602f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:46.007914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dc48db43-fe07-4542-890b-c94c7e29602f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:46.142354 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-dc48db43-fe07-4542-890b-c94c7e29602f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:46.151251 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-dc48db43-fe07-4542-890b-c94c7e29602f tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.160874 Aug 04 14:05:46.151829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 596/1220] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:45 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:46.367251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e1c59a40-5207-44a7-857c-f165803723c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:46.368208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e1c59a40-5207-44a7-857c-f165803723c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:46.374281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1c59a40-5207-44a7-857c-f165803723c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:46.374724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1c59a40-5207-44a7-857c-f165803723c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:46.375559 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1c59a40-5207-44a7-857c-f165803723c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:46.375991 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1c59a40-5207-44a7-857c-f165803723c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:46.495027 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e1c59a40-5207-44a7-857c-f165803723c1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 27905 microversion: 2.20 time: 0.132780 Aug 04 14:05:46.495681 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 625/1221] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:46 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 27905 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:46.943779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-32b165cb-ba9c-4b61-ba7e-b97abe2e738c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:46.944313 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-32b165cb-ba9c-4b61-ba7e-b97abe2e738c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:46.950577 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-32b165cb-ba9c-4b61-ba7e-b97abe2e738c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:46.951033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-32b165cb-ba9c-4b61-ba7e-b97abe2e738c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:46.951813 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-32b165cb-ba9c-4b61-ba7e-b97abe2e738c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:46.952260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-32b165cb-ba9c-4b61-ba7e-b97abe2e738c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:47.085361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-32b165cb-ba9c-4b61-ba7e-b97abe2e738c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:47.094194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-32b165cb-ba9c-4b61-ba7e-b97abe2e738c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.154794 Aug 04 14:05:47.096934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 597/1222] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:46 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:47.172422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-03101a97-c052-47fd-b1c8-cd48b8ea190d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:47.173646 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-03101a97-c052-47fd-b1c8-cd48b8ea190d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:47.182839 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03101a97-c052-47fd-b1c8-cd48b8ea190d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:47.183480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03101a97-c052-47fd-b1c8-cd48b8ea190d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:47.184770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03101a97-c052-47fd-b1c8-cd48b8ea190d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:47.185353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03101a97-c052-47fd-b1c8-cd48b8ea190d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:47.511325 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-445e6ad1-b97b-40fc-814f-56ccc8d0bc08 req-3c77e021-fcf7-4fb5-9e5d-44d810e16e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5430baac-88c3-40da-84c8-caffc9d919ea", "tag": "e6a078d9-303d-4b39-8a39-f1f3a2797f43"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:47.514430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:05:47.514430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:05:47.526668 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-445e6ad1-b97b-40fc-814f-56ccc8d0bc08 req-3c77e021-fcf7-4fb5-9e5d-44d810e16e3a service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:47.527113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-445e6ad1-b97b-40fc-814f-56ccc8d0bc08 req-3c77e021-fcf7-4fb5-9e5d-44d810e16e3a service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:47.550889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-445e6ad1-b97b-40fc-814f-56ccc8d0bc08 req-3c77e021-fcf7-4fb5-9e5d-44d810e16e3a service nova] Creating event network-changed:e6a078d9-303d-4b39-8a39-f1f3a2797f43 for instance 5430baac-88c3-40da-84c8-caffc9d919ea on hv-cinder-79264 Aug 04 14:05:47.560717 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-445e6ad1-b97b-40fc-814f-56ccc8d0bc08 req-3c77e021-fcf7-4fb5-9e5d-44d810e16e3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060135 Aug 04 14:05:47.562048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 598/1223] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:05:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:47.568074 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ef4c6af8-4b1e-4a6f-baac-434f09d32d15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:47.569431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ef4c6af8-4b1e-4a6f-baac-434f09d32d15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:47.576142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef4c6af8-4b1e-4a6f-baac-434f09d32d15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:47.576618 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef4c6af8-4b1e-4a6f-baac-434f09d32d15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:47.577398 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef4c6af8-4b1e-4a6f-baac-434f09d32d15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:47.577828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef4c6af8-4b1e-4a6f-baac-434f09d32d15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:47.632402 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-03101a97-c052-47fd-b1c8-cd48b8ea190d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:47.640441 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-03101a97-c052-47fd-b1c8-cd48b8ea190d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.474433 Aug 04 14:05:47.641076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 626/1224] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:47 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:47.698039 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ef4c6af8-4b1e-4a6f-baac-434f09d32d15 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.134387 Aug 04 14:05:47.699187 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 599/1225] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:47 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:48.110903 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a874f11c-fbcc-49c8-bc91-e490166e2710 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:48.111511 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a874f11c-fbcc-49c8-bc91-e490166e2710 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:48.117461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a874f11c-fbcc-49c8-bc91-e490166e2710 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:48.117912 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a874f11c-fbcc-49c8-bc91-e490166e2710 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:48.118684 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a874f11c-fbcc-49c8-bc91-e490166e2710 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:48.119139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a874f11c-fbcc-49c8-bc91-e490166e2710 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:48.340582 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a874f11c-fbcc-49c8-bc91-e490166e2710 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:48.349238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a874f11c-fbcc-49c8-bc91-e490166e2710 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.240943 Aug 04 14:05:48.350249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 627/1226] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:48 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:48.658357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5c117e69-b647-4161-a1b9-bf906a95bde0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:48.659038 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5c117e69-b647-4161-a1b9-bf906a95bde0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:48.666389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c117e69-b647-4161-a1b9-bf906a95bde0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:48.666829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c117e69-b647-4161-a1b9-bf906a95bde0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:48.667604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c117e69-b647-4161-a1b9-bf906a95bde0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:48.668026 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c117e69-b647-4161-a1b9-bf906a95bde0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:48.710835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b7d3f74-21b7-448e-b769-46446ac4a89d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:48.711743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b7d3f74-21b7-448e-b769-46446ac4a89d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:48.717906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b7d3f74-21b7-448e-b769-46446ac4a89d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:48.718343 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b7d3f74-21b7-448e-b769-46446ac4a89d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:48.719112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b7d3f74-21b7-448e-b769-46446ac4a89d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:48.719533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b7d3f74-21b7-448e-b769-46446ac4a89d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:48.806039 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5c117e69-b647-4161-a1b9-bf906a95bde0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:48.812358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b7d3f74-21b7-448e-b769-46446ac4a89d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.105507 Aug 04 14:05:48.813461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 628/1227] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:48 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:05:48.814444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5c117e69-b647-4161-a1b9-bf906a95bde0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1758 microversion: 2.1 time: 0.160066 Aug 04 14:05:48.815027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 600/1228] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:48 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:49.372335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-02bd7a70-4145-4a3b-ae06-2645e53784cf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:49.373032 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-02bd7a70-4145-4a3b-ae06-2645e53784cf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:49.379357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-02bd7a70-4145-4a3b-ae06-2645e53784cf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:49.379794 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-02bd7a70-4145-4a3b-ae06-2645e53784cf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:49.380640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-02bd7a70-4145-4a3b-ae06-2645e53784cf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:49.381138 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-02bd7a70-4145-4a3b-ae06-2645e53784cf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:49.509523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-02bd7a70-4145-4a3b-ae06-2645e53784cf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:49.516973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-02bd7a70-4145-4a3b-ae06-2645e53784cf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.148620 Aug 04 14:05:49.517538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 629/1229] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:49 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:49.824636 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8fedc871-c2c9-4f8b-a803-f3ebfb95fb98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:49.825547 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8fedc871-c2c9-4f8b-a803-f3ebfb95fb98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:49.831894 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8fedc871-c2c9-4f8b-a803-f3ebfb95fb98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:49.832374 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8fedc871-c2c9-4f8b-a803-f3ebfb95fb98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:49.833847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8fedc871-c2c9-4f8b-a803-f3ebfb95fb98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:49.834236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fec2c334-6a54-4aad-a063-19df9654af21 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:49.834395 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8fedc871-c2c9-4f8b-a803-f3ebfb95fb98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:49.834841 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fec2c334-6a54-4aad-a063-19df9654af21 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:49.840615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fec2c334-6a54-4aad-a063-19df9654af21 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:49.841085 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fec2c334-6a54-4aad-a063-19df9654af21 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:49.841848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fec2c334-6a54-4aad-a063-19df9654af21 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:49.842311 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fec2c334-6a54-4aad-a063-19df9654af21 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:49.939895 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8fedc871-c2c9-4f8b-a803-f3ebfb95fb98 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.119085 Aug 04 14:05:49.940994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 601/1230] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:49 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:05:49.972632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fec2c334-6a54-4aad-a063-19df9654af21 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:49.981194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fec2c334-6a54-4aad-a063-19df9654af21 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1761 microversion: 2.1 time: 0.151541 Aug 04 14:05:49.981756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 630/1231] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:49 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1761 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:50.535254 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-298155ed-42f9-48b4-8a3b-3430adb34cf8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:50.536754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-298155ed-42f9-48b4-8a3b-3430adb34cf8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:50.544147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-298155ed-42f9-48b4-8a3b-3430adb34cf8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:50.544615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-298155ed-42f9-48b4-8a3b-3430adb34cf8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:50.545392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-298155ed-42f9-48b4-8a3b-3430adb34cf8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:50.545821 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-298155ed-42f9-48b4-8a3b-3430adb34cf8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:50.686572 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-298155ed-42f9-48b4-8a3b-3430adb34cf8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:50.697148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-298155ed-42f9-48b4-8a3b-3430adb34cf8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.165945 Aug 04 14:05:50.697736 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 602/1232] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:50 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:50.951620 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-925c8da9-f367-4c6e-8f10-61300dea52f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:50.953170 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-925c8da9-f367-4c6e-8f10-61300dea52f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:50.959662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-925c8da9-f367-4c6e-8f10-61300dea52f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:50.960109 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-925c8da9-f367-4c6e-8f10-61300dea52f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:50.960948 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-925c8da9-f367-4c6e-8f10-61300dea52f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:50.961384 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-925c8da9-f367-4c6e-8f10-61300dea52f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:51.058078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-925c8da9-f367-4c6e-8f10-61300dea52f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.110354 Aug 04 14:05:51.058722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 631/1233] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:50 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:51.714404 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-20070192-d374-4b1e-9443-aaaabf852583 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:51.715019 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-20070192-d374-4b1e-9443-aaaabf852583 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:51.721212 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-20070192-d374-4b1e-9443-aaaabf852583 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:51.721658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-20070192-d374-4b1e-9443-aaaabf852583 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:51.722420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-20070192-d374-4b1e-9443-aaaabf852583 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:51.722848 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-20070192-d374-4b1e-9443-aaaabf852583 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:51.845085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-20070192-d374-4b1e-9443-aaaabf852583 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:51.852353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-20070192-d374-4b1e-9443-aaaabf852583 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.141632 Aug 04 14:05:51.852937 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 603/1234] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:51 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:52.069918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-50b75048-d7b8-47e4-9b8b-6f7e5ef2911f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:52.070899 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-50b75048-d7b8-47e4-9b8b-6f7e5ef2911f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:52.077523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50b75048-d7b8-47e4-9b8b-6f7e5ef2911f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:52.077965 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50b75048-d7b8-47e4-9b8b-6f7e5ef2911f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:52.078725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50b75048-d7b8-47e4-9b8b-6f7e5ef2911f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:52.079152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-50b75048-d7b8-47e4-9b8b-6f7e5ef2911f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:52.164524 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-50b75048-d7b8-47e4-9b8b-6f7e5ef2911f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.098415 Aug 04 14:05:52.165432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 632/1235] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:52 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:52.868652 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-078406e9-3259-4324-a498-ea261efdacfa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:52.869253 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-078406e9-3259-4324-a498-ea261efdacfa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:52.875172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-078406e9-3259-4324-a498-ea261efdacfa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:52.875624 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-078406e9-3259-4324-a498-ea261efdacfa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:52.876441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-078406e9-3259-4324-a498-ea261efdacfa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:52.876945 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-078406e9-3259-4324-a498-ea261efdacfa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:52.999471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-078406e9-3259-4324-a498-ea261efdacfa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:53.007314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-078406e9-3259-4324-a498-ea261efdacfa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.142402 Aug 04 14:05:53.007869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 604/1236] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:52 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:53.177796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-843d94df-4170-4cac-ae96-f9a8a553426f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:53.178695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-843d94df-4170-4cac-ae96-f9a8a553426f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:53.185161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-843d94df-4170-4cac-ae96-f9a8a553426f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:53.185602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-843d94df-4170-4cac-ae96-f9a8a553426f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:53.186368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-843d94df-4170-4cac-ae96-f9a8a553426f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:53.186826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-843d94df-4170-4cac-ae96-f9a8a553426f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:53.278919 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-843d94df-4170-4cac-ae96-f9a8a553426f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.106027 Aug 04 14:05:53.279567 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 633/1237] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:53 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:54.024475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-09131dda-37ba-477f-b92e-d76a66292501 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:54.025081 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-09131dda-37ba-477f-b92e-d76a66292501 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:54.031197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-09131dda-37ba-477f-b92e-d76a66292501 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:54.031646 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-09131dda-37ba-477f-b92e-d76a66292501 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:54.032444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-09131dda-37ba-477f-b92e-d76a66292501 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:54.032880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-09131dda-37ba-477f-b92e-d76a66292501 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:54.157598 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-09131dda-37ba-477f-b92e-d76a66292501 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:54.164943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-09131dda-37ba-477f-b92e-d76a66292501 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.144657 Aug 04 14:05:54.165517 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 605/1238] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:54 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:54.291633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-56186b55-5642-4a26-8c73-c9ce66b49336 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:54.292674 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-56186b55-5642-4a26-8c73-c9ce66b49336 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:54.299046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56186b55-5642-4a26-8c73-c9ce66b49336 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:54.299493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56186b55-5642-4a26-8c73-c9ce66b49336 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:54.300279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56186b55-5642-4a26-8c73-c9ce66b49336 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:54.300736 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-56186b55-5642-4a26-8c73-c9ce66b49336 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:54.393445 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-56186b55-5642-4a26-8c73-c9ce66b49336 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.105725 Aug 04 14:05:54.394086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 634/1239] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:54 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:05:55.182273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c04327b8-0f10-431a-85bf-f19cc6edee47 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:55.182880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c04327b8-0f10-431a-85bf-f19cc6edee47 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:55.188642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c04327b8-0f10-431a-85bf-f19cc6edee47 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:55.189088 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c04327b8-0f10-431a-85bf-f19cc6edee47 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:55.189853 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c04327b8-0f10-431a-85bf-f19cc6edee47 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:55.190277 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c04327b8-0f10-431a-85bf-f19cc6edee47 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:55.309933 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c04327b8-0f10-431a-85bf-f19cc6edee47 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:55.317369 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c04327b8-0f10-431a-85bf-f19cc6edee47 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.138744 Aug 04 14:05:55.317934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 606/1240] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:55 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:55.406262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a6b4540a-210a-416b-b449-7b507be2de5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:55.407273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a6b4540a-210a-416b-b449-7b507be2de5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:55.414667 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6b4540a-210a-416b-b449-7b507be2de5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:55.415107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6b4540a-210a-416b-b449-7b507be2de5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:55.415864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6b4540a-210a-416b-b449-7b507be2de5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:55.416318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a6b4540a-210a-416b-b449-7b507be2de5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:55.509729 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a6b4540a-210a-416b-b449-7b507be2de5f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.107606 Aug 04 14:05:55.511264 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 635/1241] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:55 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:55.750280 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-3d4c4c3a-9259-4ca7-ad3e-f885b6bbc096 req-bc6db9f6-0c1e-4627-9ebc-3b8a5b51c47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5430baac-88c3-40da-84c8-caffc9d919ea", "name": "network-vif-plugged", "status": "completed", "tag": "e6a078d9-303d-4b39-8a39-f1f3a2797f43"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:55.751836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:05:55.751836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:05:55.760087 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-3d4c4c3a-9259-4ca7-ad3e-f885b6bbc096 req-bc6db9f6-0c1e-4627-9ebc-3b8a5b51c47a service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:55.760554 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-3d4c4c3a-9259-4ca7-ad3e-f885b6bbc096 req-bc6db9f6-0c1e-4627-9ebc-3b8a5b51c47a service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:55.772803 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-3d4c4c3a-9259-4ca7-ad3e-f885b6bbc096 req-bc6db9f6-0c1e-4627-9ebc-3b8a5b51c47a service nova] Creating event network-vif-plugged:e6a078d9-303d-4b39-8a39-f1f3a2797f43 for instance 5430baac-88c3-40da-84c8-caffc9d919ea on hv-cinder-79264 Aug 04 14:05:55.777743 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-3d4c4c3a-9259-4ca7-ad3e-f885b6bbc096 req-bc6db9f6-0c1e-4627-9ebc-3b8a5b51c47a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031055 Aug 04 14:05:55.778356 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 607/1242] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:05:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:56.338468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1849c353-8640-47e7-a762-8a7692dd00ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:56.339074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1849c353-8640-47e7-a762-8a7692dd00ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:56.345540 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1849c353-8640-47e7-a762-8a7692dd00ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:56.345989 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1849c353-8640-47e7-a762-8a7692dd00ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:56.346754 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1849c353-8640-47e7-a762-8a7692dd00ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:56.347181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1849c353-8640-47e7-a762-8a7692dd00ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:56.475641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1849c353-8640-47e7-a762-8a7692dd00ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:56.482939 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1849c353-8640-47e7-a762-8a7692dd00ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.148596 Aug 04 14:05:56.483500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 636/1243] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:56 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:56.522556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1c92172a-1995-4c11-93e2-a08b09253a48 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:56.523533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1c92172a-1995-4c11-93e2-a08b09253a48 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:56.529885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c92172a-1995-4c11-93e2-a08b09253a48 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:56.530323 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c92172a-1995-4c11-93e2-a08b09253a48 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:56.531076 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c92172a-1995-4c11-93e2-a08b09253a48 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:56.531501 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c92172a-1995-4c11-93e2-a08b09253a48 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:56.648653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1c92172a-1995-4c11-93e2-a08b09253a48 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.130250 Aug 04 14:05:56.649242 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 608/1244] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:56 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:57.500675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-070b633b-ef7f-4c08-ad45-90194c34a97b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:57.501272 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-070b633b-ef7f-4c08-ad45-90194c34a97b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:57.508455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-070b633b-ef7f-4c08-ad45-90194c34a97b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:57.508897 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-070b633b-ef7f-4c08-ad45-90194c34a97b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:57.509695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-070b633b-ef7f-4c08-ad45-90194c34a97b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:57.510123 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-070b633b-ef7f-4c08-ad45-90194c34a97b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:57.634605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-070b633b-ef7f-4c08-ad45-90194c34a97b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:57.641768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-070b633b-ef7f-4c08-ad45-90194c34a97b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1363 microversion: 2.1 time: 0.144813 Aug 04 14:05:57.642323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 637/1245] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:57 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:57.660529 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-92813211-734f-4dd2-a27b-72918d52cde2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:57.661524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-92813211-734f-4dd2-a27b-72918d52cde2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:57.668162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92813211-734f-4dd2-a27b-72918d52cde2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:57.668640 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92813211-734f-4dd2-a27b-72918d52cde2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:57.669406 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92813211-734f-4dd2-a27b-72918d52cde2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:57.669837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92813211-734f-4dd2-a27b-72918d52cde2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:57.792760 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-92813211-734f-4dd2-a27b-72918d52cde2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.136064 Aug 04 14:05:57.793454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 609/1246] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:57 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:58.659054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6548c9d3-a9f1-4131-a94a-9705bf4c8c36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:58.659594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6548c9d3-a9f1-4131-a94a-9705bf4c8c36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:58.665481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6548c9d3-a9f1-4131-a94a-9705bf4c8c36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:58.665918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6548c9d3-a9f1-4131-a94a-9705bf4c8c36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:58.666678 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6548c9d3-a9f1-4131-a94a-9705bf4c8c36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:58.667100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6548c9d3-a9f1-4131-a94a-9705bf4c8c36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:58.792715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-6548c9d3-a9f1-4131-a94a-9705bf4c8c36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:58.799873 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6548c9d3-a9f1-4131-a94a-9705bf4c8c36 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1549 microversion: 2.1 time: 0.144578 Aug 04 14:05:58.800453 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 638/1247] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:05:58 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:58.805108 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0f274377-c407-4b76-ac2e-2f97113295d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:58.806126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0f274377-c407-4b76-ac2e-2f97113295d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:58.812710 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0f274377-c407-4b76-ac2e-2f97113295d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:58.813154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0f274377-c407-4b76-ac2e-2f97113295d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:58.813951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0f274377-c407-4b76-ac2e-2f97113295d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:58.814614 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0f274377-c407-4b76-ac2e-2f97113295d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:58.815757 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f399e077-4769-47c7-ac4a-da356380a180 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:58.816300 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f399e077-4769-47c7-ac4a-da356380a180 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:58.822788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f399e077-4769-47c7-ac4a-da356380a180 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:58.823232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f399e077-4769-47c7-ac4a-da356380a180 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:58.824293 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f399e077-4769-47c7-ac4a-da356380a180 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:58.824727 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f399e077-4769-47c7-ac4a-da356380a180 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:58.901809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0f274377-c407-4b76-ac2e-2f97113295d0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.100758 Aug 04 14:05:58.904017 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 610/1248] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:58 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:05:58.904154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f399e077-4769-47c7-ac4a-da356380a180 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091073 Aug 04 14:05:58.904154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 639/1249] 10.222.0.43 () {58 vars in 1275 bytes} [Wed Aug 4 14:05:58 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:05:59.880477 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0e1315f8-de6c-4df0-b7b0-b0277377dab3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:59.882868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-8c7d3be7-fde5-498d-b6f1-3e885a9edf9c req-952544d2-60ac-418d-b3c2-e73c062b0f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5430baac-88c3-40da-84c8-caffc9d919ea", "tag": "e6a078d9-303d-4b39-8a39-f1f3a2797f43"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:59.885008 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:05:59.885008 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:05:59.886009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0e1315f8-de6c-4df0-b7b0-b0277377dab3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:59.892247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-8c7d3be7-fde5-498d-b6f1-3e885a9edf9c req-952544d2-60ac-418d-b3c2-e73c062b0f71 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:59.892699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-8c7d3be7-fde5-498d-b6f1-3e885a9edf9c req-952544d2-60ac-418d-b3c2-e73c062b0f71 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:59.893219 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0e1315f8-de6c-4df0-b7b0-b0277377dab3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:59.893757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0e1315f8-de6c-4df0-b7b0-b0277377dab3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:59.894698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0e1315f8-de6c-4df0-b7b0-b0277377dab3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:59.895382 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0e1315f8-de6c-4df0-b7b0-b0277377dab3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:59.905285 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-8c7d3be7-fde5-498d-b6f1-3e885a9edf9c req-952544d2-60ac-418d-b3c2-e73c062b0f71 service nova] Creating event network-changed:e6a078d9-303d-4b39-8a39-f1f3a2797f43 for instance 5430baac-88c3-40da-84c8-caffc9d919ea on hv-cinder-79264 Aug 04 14:05:59.910772 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-8c7d3be7-fde5-498d-b6f1-3e885a9edf9c req-952544d2-60ac-418d-b3c2-e73c062b0f71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032703 Aug 04 14:05:59.911665 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 640/1250] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:05:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:59.917139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4c19e4db-914c-48c7-b03f-831e7aaa4fa9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:59.918160 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4c19e4db-914c-48c7-b03f-831e7aaa4fa9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:05:59.924278 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c19e4db-914c-48c7-b03f-831e7aaa4fa9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:59.924730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c19e4db-914c-48c7-b03f-831e7aaa4fa9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:05:59.925510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c19e4db-914c-48c7-b03f-831e7aaa4fa9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:05:59.926457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c19e4db-914c-48c7-b03f-831e7aaa4fa9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:00.026056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0e1315f8-de6c-4df0-b7b0-b0277377dab3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 0.150181 Aug 04 14:06:00.029722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 611/1251] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:05:59 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:00.072645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4c19e4db-914c-48c7-b03f-831e7aaa4fa9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.159282 Aug 04 14:06:00.077066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 641/1252] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:05:59 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:01.038545 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-680697a5-a935-478c-916d-683c9799fbef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:01.039559 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-680697a5-a935-478c-916d-683c9799fbef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:01.045925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680697a5-a935-478c-916d-683c9799fbef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:01.046368 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680697a5-a935-478c-916d-683c9799fbef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:01.047120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680697a5-a935-478c-916d-683c9799fbef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:01.047545 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680697a5-a935-478c-916d-683c9799fbef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:01.084932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a81aa58e-bbad-4095-afd0-919431bfa785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:01.085906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a81aa58e-bbad-4095-afd0-919431bfa785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:01.092334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a81aa58e-bbad-4095-afd0-919431bfa785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:01.092806 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a81aa58e-bbad-4095-afd0-919431bfa785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:01.093559 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a81aa58e-bbad-4095-afd0-919431bfa785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:01.093985 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a81aa58e-bbad-4095-afd0-919431bfa785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:01.143271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-680697a5-a935-478c-916d-683c9799fbef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 0.109619 Aug 04 14:06:01.143914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 612/1253] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:01 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:01.217868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a81aa58e-bbad-4095-afd0-919431bfa785 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.136972 Aug 04 14:06:01.218817 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 642/1254] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:01 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:02.153915 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-74f31657-0e74-4bb4-a4c3-087dcbc75e0a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:02.154869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-74f31657-0e74-4bb4-a4c3-087dcbc75e0a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:02.161646 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74f31657-0e74-4bb4-a4c3-087dcbc75e0a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:02.162090 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74f31657-0e74-4bb4-a4c3-087dcbc75e0a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:02.162865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74f31657-0e74-4bb4-a4c3-087dcbc75e0a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:02.163301 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-74f31657-0e74-4bb4-a4c3-087dcbc75e0a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:02.229754 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8e84eed4-ad98-4037-ad4a-c6627cef53b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:02.230749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8e84eed4-ad98-4037-ad4a-c6627cef53b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:02.237111 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e84eed4-ad98-4037-ad4a-c6627cef53b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:02.237549 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e84eed4-ad98-4037-ad4a-c6627cef53b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:02.238302 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e84eed4-ad98-4037-ad4a-c6627cef53b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:02.239235 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e84eed4-ad98-4037-ad4a-c6627cef53b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:02.255741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-74f31657-0e74-4bb4-a4c3-087dcbc75e0a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 0.105742 Aug 04 14:06:02.258798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 613/1255] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:02 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:02.327098 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8e84eed4-ad98-4037-ad4a-c6627cef53b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28233 microversion: 2.20 time: 0.101181 Aug 04 14:06:02.327734 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 643/1256] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:02 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28233 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:03.266541 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-290c94ad-a69a-43dc-a6a9-f46aabdeb8e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:03.267589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-290c94ad-a69a-43dc-a6a9-f46aabdeb8e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:03.274448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-290c94ad-a69a-43dc-a6a9-f46aabdeb8e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:03.274885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-290c94ad-a69a-43dc-a6a9-f46aabdeb8e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:03.275642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-290c94ad-a69a-43dc-a6a9-f46aabdeb8e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:03.276065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-290c94ad-a69a-43dc-a6a9-f46aabdeb8e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:03.339194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2594db83-4b5f-4d0d-91b3-11d75ffd765d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:03.340168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2594db83-4b5f-4d0d-91b3-11d75ffd765d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:03.346529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2594db83-4b5f-4d0d-91b3-11d75ffd765d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:03.346965 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2594db83-4b5f-4d0d-91b3-11d75ffd765d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:03.348209 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2594db83-4b5f-4d0d-91b3-11d75ffd765d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:03.348699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2594db83-4b5f-4d0d-91b3-11d75ffd765d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:03.370482 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-290c94ad-a69a-43dc-a6a9-f46aabdeb8e2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 0.107865 Aug 04 14:06:03.373756 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 614/1257] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:03 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:03.449172 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2594db83-4b5f-4d0d-91b3-11d75ffd765d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28524 microversion: 2.20 time: 0.113217 Aug 04 14:06:03.450250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 644/1258] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:03 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28524 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:04.382570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0130e657-0e27-435e-881f-13ec539c7893 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:04.383562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0130e657-0e27-435e-881f-13ec539c7893 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:04.390235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0130e657-0e27-435e-881f-13ec539c7893 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:04.390687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0130e657-0e27-435e-881f-13ec539c7893 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:04.391451 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0130e657-0e27-435e-881f-13ec539c7893 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:04.391882 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0130e657-0e27-435e-881f-13ec539c7893 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:04.460686 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1ac250a4-7fe1-4aef-9b09-9731c0ad0e02 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:04.461681 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1ac250a4-7fe1-4aef-9b09-9731c0ad0e02 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:04.468166 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1ac250a4-7fe1-4aef-9b09-9731c0ad0e02 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:04.468636 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1ac250a4-7fe1-4aef-9b09-9731c0ad0e02 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:04.469419 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1ac250a4-7fe1-4aef-9b09-9731c0ad0e02 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:04.469837 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1ac250a4-7fe1-4aef-9b09-9731c0ad0e02 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:04.477086 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0130e657-0e27-435e-881f-13ec539c7893 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 0.099127 Aug 04 14:06:04.477744 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 615/1259] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:04 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 14:06:04.565410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1ac250a4-7fe1-4aef-9b09-9731c0ad0e02 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28524 microversion: 2.20 time: 0.108589 Aug 04 14:06:04.566061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 645/1260] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:04 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28524 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:05.488027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-428401b1-2516-4ea3-80d4-557aaca14d58 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:05.489071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-428401b1-2516-4ea3-80d4-557aaca14d58 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:05.495512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-428401b1-2516-4ea3-80d4-557aaca14d58 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:05.495954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-428401b1-2516-4ea3-80d4-557aaca14d58 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:05.496748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-428401b1-2516-4ea3-80d4-557aaca14d58 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:05.497184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-428401b1-2516-4ea3-80d4-557aaca14d58 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:05.578303 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0ad737ea-01a3-4f9d-8f12-9f5041a41f33 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:05.579288 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0ad737ea-01a3-4f9d-8f12-9f5041a41f33 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:05.586521 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ad737ea-01a3-4f9d-8f12-9f5041a41f33 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:05.586951 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ad737ea-01a3-4f9d-8f12-9f5041a41f33 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:05.587728 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ad737ea-01a3-4f9d-8f12-9f5041a41f33 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:05.588151 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0ad737ea-01a3-4f9d-8f12-9f5041a41f33 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:05.589017 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-428401b1-2516-4ea3-80d4-557aaca14d58 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 0.104774 Aug 04 14:06:05.592418 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 616/1261] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:05 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:05.693662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0ad737ea-01a3-4f9d-8f12-9f5041a41f33 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.118482 Aug 04 14:06:05.697901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 646/1262] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:05 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:06.600850 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cdbed0c5-e843-4c07-a83f-721d16f33c3b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:06.601840 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cdbed0c5-e843-4c07-a83f-721d16f33c3b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:06.608309 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cdbed0c5-e843-4c07-a83f-721d16f33c3b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:06.608762 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cdbed0c5-e843-4c07-a83f-721d16f33c3b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:06.609567 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cdbed0c5-e843-4c07-a83f-721d16f33c3b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:06.610003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cdbed0c5-e843-4c07-a83f-721d16f33c3b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:06.706194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e493a048-47ea-4ee1-8dde-386a96a53fb4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:06.707740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e493a048-47ea-4ee1-8dde-386a96a53fb4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:06.714280 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e493a048-47ea-4ee1-8dde-386a96a53fb4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:06.714716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e493a048-47ea-4ee1-8dde-386a96a53fb4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:06.715468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e493a048-47ea-4ee1-8dde-386a96a53fb4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:06.715891 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e493a048-47ea-4ee1-8dde-386a96a53fb4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:10.162076 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cdbed0c5-e843-4c07-a83f-721d16f33c3b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 3.565131 Aug 04 14:06:10.162639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 617/1263] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:06 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 3567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:10.181052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e493a048-47ea-4ee1-8dde-386a96a53fb4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 3.478696 Aug 04 14:06:10.181740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 647/1264] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:06 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 3480 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:11.172798 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4515aa4f-875a-4eae-a250-e7a0c474a5cc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:11.173812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4515aa4f-875a-4eae-a250-e7a0c474a5cc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:11.180631 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4515aa4f-875a-4eae-a250-e7a0c474a5cc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:11.181079 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4515aa4f-875a-4eae-a250-e7a0c474a5cc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:11.181860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4515aa4f-875a-4eae-a250-e7a0c474a5cc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:11.182289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4515aa4f-875a-4eae-a250-e7a0c474a5cc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:11.193470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0e6c944f-8fd4-4bc8-ba20-a77548de6302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:11.194206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0e6c944f-8fd4-4bc8-ba20-a77548de6302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:11.201019 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e6c944f-8fd4-4bc8-ba20-a77548de6302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:11.201469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e6c944f-8fd4-4bc8-ba20-a77548de6302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:11.202348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e6c944f-8fd4-4bc8-ba20-a77548de6302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:11.202781 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0e6c944f-8fd4-4bc8-ba20-a77548de6302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:11.305192 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4515aa4f-875a-4eae-a250-e7a0c474a5cc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 0.136232 Aug 04 14:06:11.308512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 618/1265] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:11 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:11.349334 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0e6c944f-8fd4-4bc8-ba20-a77548de6302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.160001 Aug 04 14:06:11.349994 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 648/1266] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:11 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:12.316512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-393087cc-973b-4081-bd92-080935248d51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:12.317640 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-393087cc-973b-4081-bd92-080935248d51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:12.324290 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-393087cc-973b-4081-bd92-080935248d51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:12.324733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-393087cc-973b-4081-bd92-080935248d51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:12.325491 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-393087cc-973b-4081-bd92-080935248d51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:12.325919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-393087cc-973b-4081-bd92-080935248d51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:12.362251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2135b340-80cb-4911-b034-ea5233a6c5e3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:12.363824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2135b340-80cb-4911-b034-ea5233a6c5e3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:12.370146 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2135b340-80cb-4911-b034-ea5233a6c5e3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:12.370594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2135b340-80cb-4911-b034-ea5233a6c5e3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:12.371357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2135b340-80cb-4911-b034-ea5233a6c5e3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:12.371806 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2135b340-80cb-4911-b034-ea5233a6c5e3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:12.474264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-393087cc-973b-4081-bd92-080935248d51 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 14 microversion: 2.1 time: 0.161615 Aug 04 14:06:12.474914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 619/1267] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:12 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:12.505497 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2135b340-80cb-4911-b034-ea5233a6c5e3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.147305 Aug 04 14:06:12.506150 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 649/1268] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:12 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:13.485854 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5d5cdf8b-fe06-4a1f-aff0-8c96d2102db4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:13.486898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5d5cdf8b-fe06-4a1f-aff0-8c96d2102db4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:13.493944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5d5cdf8b-fe06-4a1f-aff0-8c96d2102db4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:13.494388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5d5cdf8b-fe06-4a1f-aff0-8c96d2102db4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:13.495157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5d5cdf8b-fe06-4a1f-aff0-8c96d2102db4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:13.495586 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5d5cdf8b-fe06-4a1f-aff0-8c96d2102db4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:13.517762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-dafdff28-90c2-496d-9033-61dcd93db38a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:13.518821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-dafdff28-90c2-496d-9033-61dcd93db38a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:13.526471 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dafdff28-90c2-496d-9033-61dcd93db38a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:13.526931 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dafdff28-90c2-496d-9033-61dcd93db38a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:13.527803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dafdff28-90c2-496d-9033-61dcd93db38a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:13.528247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-dafdff28-90c2-496d-9033-61dcd93db38a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:13.641610 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5d5cdf8b-fe06-4a1f-aff0-8c96d2102db4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 8879 microversion: 2.1 time: 0.159503 Aug 04 14:06:13.642218 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 620/1269] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:13 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 8879 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:13.686118 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-dafdff28-90c2-496d-9033-61dcd93db38a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.172394 Aug 04 14:06:13.686748 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 650/1270] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:13 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:14.653397 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3bda80d3-2577-4541-b534-4039fd2cc7fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:14.654453 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3bda80d3-2577-4541-b534-4039fd2cc7fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:14.660860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3bda80d3-2577-4541-b534-4039fd2cc7fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:14.661308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3bda80d3-2577-4541-b534-4039fd2cc7fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:14.662077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3bda80d3-2577-4541-b534-4039fd2cc7fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:14.662510 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3bda80d3-2577-4541-b534-4039fd2cc7fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:14.698875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1c6e9d14-d5a8-4632-af98-b3d93d0eb16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:14.699881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1c6e9d14-d5a8-4632-af98-b3d93d0eb16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:14.706420 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c6e9d14-d5a8-4632-af98-b3d93d0eb16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:14.707544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c6e9d14-d5a8-4632-af98-b3d93d0eb16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:14.708447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c6e9d14-d5a8-4632-af98-b3d93d0eb16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:14.708953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c6e9d14-d5a8-4632-af98-b3d93d0eb16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:14.784283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3bda80d3-2577-4541-b534-4039fd2cc7fb tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 15025 microversion: 2.1 time: 0.134786 Aug 04 14:06:14.784968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 621/1271] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:14 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 15025 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:14.818777 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1c6e9d14-d5a8-4632-af98-b3d93d0eb16a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.124018 Aug 04 14:06:14.819414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 651/1272] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:14 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:15.796333 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ccbe0644-8bcd-4e67-8885-c2024f044442 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:15.797308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ccbe0644-8bcd-4e67-8885-c2024f044442 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:15.804028 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ccbe0644-8bcd-4e67-8885-c2024f044442 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:15.804496 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ccbe0644-8bcd-4e67-8885-c2024f044442 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:15.805252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ccbe0644-8bcd-4e67-8885-c2024f044442 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:15.805677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ccbe0644-8bcd-4e67-8885-c2024f044442 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:15.833568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f6d804c0-9020-4f74-a0f2-506487f8869a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:15.834738 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f6d804c0-9020-4f74-a0f2-506487f8869a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:15.840137 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f6d804c0-9020-4f74-a0f2-506487f8869a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:15.840630 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f6d804c0-9020-4f74-a0f2-506487f8869a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:15.841405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f6d804c0-9020-4f74-a0f2-506487f8869a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:15.841835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f6d804c0-9020-4f74-a0f2-506487f8869a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:15.922430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ccbe0644-8bcd-4e67-8885-c2024f044442 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 18208 microversion: 2.1 time: 0.129993 Aug 04 14:06:15.923166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 622/1273] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:15 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 18208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:15.952659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f6d804c0-9020-4f74-a0f2-506487f8869a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.125320 Aug 04 14:06:15.953340 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 652/1274] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:15 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:16.739281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-242622687", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866386038", "security_groups": [{"name": "tempest-secgroup-smoke-1201868746"}], "block_device_mapping_v2": [{"uuid": "e56c172f-7ebf-47e0-8692-f9e94344648e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77be53e2-6c8e-4582-aec6-d3baff66b203"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:16.841694 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] validate_networks() for [('77be53e2-6c8e-4582-aec6-d3baff66b203', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:06:16.935159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-95caf20d-ab50-48e5-96b0-bb31b04dfb98 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:16.936053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-95caf20d-ab50-48e5-96b0-bb31b04dfb98 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:16.943161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95caf20d-ab50-48e5-96b0-bb31b04dfb98 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:16.943599 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95caf20d-ab50-48e5-96b0-bb31b04dfb98 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:16.944397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95caf20d-ab50-48e5-96b0-bb31b04dfb98 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:16.944820 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-95caf20d-ab50-48e5-96b0-bb31b04dfb98 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:17.060693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-95caf20d-ab50-48e5-96b0-bb31b04dfb98 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 19342 microversion: 2.1 time: 0.129674 Aug 04 14:06:17.061343 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 653/1275] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:16 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 19342 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:06:17.066414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b4f62c39-74f5-4cf7-93d1-203ab611b4ac tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:17.067396 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b4f62c39-74f5-4cf7-93d1-203ab611b4ac tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:17.074136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4f62c39-74f5-4cf7-93d1-203ab611b4ac tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:17.074835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4f62c39-74f5-4cf7-93d1-203ab611b4ac tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:17.075424 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4f62c39-74f5-4cf7-93d1-203ab611b4ac tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:17.075869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b4f62c39-74f5-4cf7-93d1-203ab611b4ac tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:17.181001 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b4f62c39-74f5-4cf7-93d1-203ab611b4ac tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.118191 Aug 04 14:06:17.184864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 654/1276] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:17 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:17.219916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:17.220372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:17.220871 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:17.221276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:17.221713 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:17.230830 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:17.231273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:17.232069 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:17.232526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:17.248460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:06:17.252326 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Getting quotas for user 829a37a970b04d14a0b13b5d54ae2f24 and project 1e5ccb2cd26145b7bcd0a36e172762d0. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:06:17.312266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:06:17.314458 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e56c172f-7ebf-47e0-8692-f9e94344648e',volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:06:17.435010 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-824b68ee-f650-4853-a5ab-c12e98cd48ed tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.699808 Aug 04 14:06:17.435669 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 623/1277] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:06:16 2021] POST /compute/v2.1/servers => generated 406 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:17.446743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2bb2f103-a562-4cf3-967e-0b63c187d83d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:17.447445 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2bb2f103-a562-4cf3-967e-0b63c187d83d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:17.499821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2bb2f103-a562-4cf3-967e-0b63c187d83d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:17.506911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2bb2f103-a562-4cf3-967e-0b63c187d83d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1094 microversion: 2.1 time: 0.064259 Aug 04 14:06:17.507466 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 655/1278] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:17 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:18.074937 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4d8d2179-167e-4c5b-9b01-79204d15a457 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:18.075911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4d8d2179-167e-4c5b-9b01-79204d15a457 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:18.082160 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d8d2179-167e-4c5b-9b01-79204d15a457 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:18.082914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d8d2179-167e-4c5b-9b01-79204d15a457 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:18.083968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d8d2179-167e-4c5b-9b01-79204d15a457 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:18.084516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d8d2179-167e-4c5b-9b01-79204d15a457 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:18.187605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4d8d2179-167e-4c5b-9b01-79204d15a457 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 22217 microversion: 2.1 time: 0.117885 Aug 04 14:06:18.188177 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 624/1279] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:18 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 22217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:18.192937 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-baba4473-0974-4945-879b-533baf2936fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:18.193901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-baba4473-0974-4945-879b-533baf2936fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:18.202505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baba4473-0974-4945-879b-533baf2936fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:18.202954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baba4473-0974-4945-879b-533baf2936fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:18.203789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baba4473-0974-4945-879b-533baf2936fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:18.204249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baba4473-0974-4945-879b-533baf2936fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:18.293058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-baba4473-0974-4945-879b-533baf2936fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.103580 Aug 04 14:06:18.294102 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 656/1280] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:18 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:18.524842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5079f013-fe1c-4c7f-a889-9e1504c589a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:18.525596 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5079f013-fe1c-4c7f-a889-9e1504c589a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:18.587977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-5079f013-fe1c-4c7f-a889-9e1504c589a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:18.594695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5079f013-fe1c-4c7f-a889-9e1504c589a1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1094 microversion: 2.1 time: 0.075124 Aug 04 14:06:18.595318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 625/1281] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:18 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:19.200046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-51917566-57be-40b5-bedd-becc22b9fade tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:19.200956 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-51917566-57be-40b5-bedd-becc22b9fade tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:19.207539 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-51917566-57be-40b5-bedd-becc22b9fade tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:19.207983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-51917566-57be-40b5-bedd-becc22b9fade tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:19.208773 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-51917566-57be-40b5-bedd-becc22b9fade tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:19.209199 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-51917566-57be-40b5-bedd-becc22b9fade tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:19.303724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-51917566-57be-40b5-bedd-becc22b9fade tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 23233 microversion: 2.1 time: 0.107815 Aug 04 14:06:19.307439 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 657/1282] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:19 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 23233 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:19.307588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8019b582-dc06-4f85-901b-d89b12d124c2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:19.307588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8019b582-dc06-4f85-901b-d89b12d124c2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:19.312485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8019b582-dc06-4f85-901b-d89b12d124c2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:19.312930 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8019b582-dc06-4f85-901b-d89b12d124c2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:19.313696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8019b582-dc06-4f85-901b-d89b12d124c2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:19.314124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8019b582-dc06-4f85-901b-d89b12d124c2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:19.400090 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8019b582-dc06-4f85-901b-d89b12d124c2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.098834 Aug 04 14:06:19.401121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 626/1283] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:19 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:19.612940 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0c641b26-43a3-4660-b8c8-1df654714813 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:19.613552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0c641b26-43a3-4660-b8c8-1df654714813 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:19.619971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0c641b26-43a3-4660-b8c8-1df654714813 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:19.620447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0c641b26-43a3-4660-b8c8-1df654714813 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:19.621215 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0c641b26-43a3-4660-b8c8-1df654714813 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:19.621645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0c641b26-43a3-4660-b8c8-1df654714813 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:19.680455 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0c641b26-43a3-4660-b8c8-1df654714813 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:19.690614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0c641b26-43a3-4660-b8c8-1df654714813 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1144 microversion: 2.1 time: 0.081755 Aug 04 14:06:19.691788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 658/1284] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:19 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:20.315835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c57f2441-be6d-4580-93fa-e8555ff7ccb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:20.317529 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c57f2441-be6d-4580-93fa-e8555ff7ccb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:20.324295 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c57f2441-be6d-4580-93fa-e8555ff7ccb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:20.324772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c57f2441-be6d-4580-93fa-e8555ff7ccb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:20.325536 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c57f2441-be6d-4580-93fa-e8555ff7ccb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:20.325992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c57f2441-be6d-4580-93fa-e8555ff7ccb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:20.411667 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3bf1556e-7892-4c39-9bea-e78158a186d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:20.412593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3bf1556e-7892-4c39-9bea-e78158a186d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:20.418362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3bf1556e-7892-4c39-9bea-e78158a186d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:20.418799 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3bf1556e-7892-4c39-9bea-e78158a186d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:20.419547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3bf1556e-7892-4c39-9bea-e78158a186d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:20.419969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3bf1556e-7892-4c39-9bea-e78158a186d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:20.424941 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c57f2441-be6d-4580-93fa-e8555ff7ccb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 24618 microversion: 2.1 time: 0.113043 Aug 04 14:06:20.427490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 627/1285] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:20 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 24618 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:20.517063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3bf1556e-7892-4c39-9bea-e78158a186d7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.109804 Aug 04 14:06:20.517709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 659/1286] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:20 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:20.708229 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-680a04a3-f297-4ed1-b095-0b71626cb5b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:20.708954 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-680a04a3-f297-4ed1-b095-0b71626cb5b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:20.716041 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680a04a3-f297-4ed1-b095-0b71626cb5b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:20.716436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680a04a3-f297-4ed1-b095-0b71626cb5b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:20.717336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680a04a3-f297-4ed1-b095-0b71626cb5b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:20.717701 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-680a04a3-f297-4ed1-b095-0b71626cb5b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:20.782005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-680a04a3-f297-4ed1-b095-0b71626cb5b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:20.790537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-680a04a3-f297-4ed1-b095-0b71626cb5b0 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1200 microversion: 2.1 time: 0.086290 Aug 04 14:06:20.791380 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 628/1287] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:20 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:21.440137 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b60ee87d-50f0-4cf6-9dfb-ae527068b33a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:21.442510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b60ee87d-50f0-4cf6-9dfb-ae527068b33a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:21.451434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b60ee87d-50f0-4cf6-9dfb-ae527068b33a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:21.451880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b60ee87d-50f0-4cf6-9dfb-ae527068b33a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:21.452690 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b60ee87d-50f0-4cf6-9dfb-ae527068b33a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:21.453125 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b60ee87d-50f0-4cf6-9dfb-ae527068b33a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:21.528965 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a6094762-c649-46a1-b860-77f13ba84389 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:21.531182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a6094762-c649-46a1-b860-77f13ba84389 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:21.538859 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6094762-c649-46a1-b860-77f13ba84389 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:21.539824 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6094762-c649-46a1-b860-77f13ba84389 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:21.540995 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6094762-c649-46a1-b860-77f13ba84389 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:21.541431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6094762-c649-46a1-b860-77f13ba84389 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:21.586609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b60ee87d-50f0-4cf6-9dfb-ae527068b33a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 25959 microversion: 2.1 time: 0.151439 Aug 04 14:06:21.596156 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 660/1288] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:21 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 25959 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:21.668303 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a6094762-c649-46a1-b860-77f13ba84389 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.142884 Aug 04 14:06:21.669023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 629/1289] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:21 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:21.808028 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c298ae0e-56de-4532-bebe-51b14bd0dfd3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:21.808819 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c298ae0e-56de-4532-bebe-51b14bd0dfd3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:21.815234 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c298ae0e-56de-4532-bebe-51b14bd0dfd3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:21.815683 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c298ae0e-56de-4532-bebe-51b14bd0dfd3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:21.816544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c298ae0e-56de-4532-bebe-51b14bd0dfd3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:21.816970 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c298ae0e-56de-4532-bebe-51b14bd0dfd3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:22.051155 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c298ae0e-56de-4532-bebe-51b14bd0dfd3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:22.059143 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c298ae0e-56de-4532-bebe-51b14bd0dfd3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.255172 Aug 04 14:06:22.059775 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 661/1290] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:21 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:22.419706 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-eed76db7-7ae8-4a26-8cc6-c81d84eaf5ca req-328d6197-dae0-4c90-9e15-8baa251ad0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f294abe-0e93-4c4a-a576-256d5711a5ec", "tag": "0d3ac144-6427-446d-ba0f-bfa1b99ceb8f"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:22.423435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:06:22.423435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:06:22.436358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-eed76db7-7ae8-4a26-8cc6-c81d84eaf5ca req-328d6197-dae0-4c90-9e15-8baa251ad0fc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:22.436781 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-eed76db7-7ae8-4a26-8cc6-c81d84eaf5ca req-328d6197-dae0-4c90-9e15-8baa251ad0fc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:22.449522 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-eed76db7-7ae8-4a26-8cc6-c81d84eaf5ca req-328d6197-dae0-4c90-9e15-8baa251ad0fc service nova] Creating event network-changed:0d3ac144-6427-446d-ba0f-bfa1b99ceb8f for instance 4f294abe-0e93-4c4a-a576-256d5711a5ec on hv-cinder-79264 Aug 04 14:06:22.454347 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-eed76db7-7ae8-4a26-8cc6-c81d84eaf5ca req-328d6197-dae0-4c90-9e15-8baa251ad0fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038737 Aug 04 14:06:22.455045 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 630/1291] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:06:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:06:22.603711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d17cf1e5-a1a6-412c-b9e0-1eddc5b0a85f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:22.604679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d17cf1e5-a1a6-412c-b9e0-1eddc5b0a85f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:22.610541 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d17cf1e5-a1a6-412c-b9e0-1eddc5b0a85f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:22.610994 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d17cf1e5-a1a6-412c-b9e0-1eddc5b0a85f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:22.611778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d17cf1e5-a1a6-412c-b9e0-1eddc5b0a85f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:22.612230 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d17cf1e5-a1a6-412c-b9e0-1eddc5b0a85f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:22.681150 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-75b83cd7-612f-4dac-ab7b-af37795e22ae tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:22.682158 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-75b83cd7-612f-4dac-ab7b-af37795e22ae tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:22.688103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-75b83cd7-612f-4dac-ab7b-af37795e22ae tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:22.688576 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-75b83cd7-612f-4dac-ab7b-af37795e22ae tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:22.689339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-75b83cd7-612f-4dac-ab7b-af37795e22ae tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:22.689766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-75b83cd7-612f-4dac-ab7b-af37795e22ae tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:22.736586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d17cf1e5-a1a6-412c-b9e0-1eddc5b0a85f tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 27162 microversion: 2.1 time: 0.136451 Aug 04 14:06:22.741165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 662/1292] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:22 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 27162 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:22.805837 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-75b83cd7-612f-4dac-ab7b-af37795e22ae tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.128548 Aug 04 14:06:22.806492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 631/1293] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:22 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:23.077245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a768c7dc-20ff-4d6d-989b-e8ae8e670611 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:23.077936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a768c7dc-20ff-4d6d-989b-e8ae8e670611 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:23.084579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a768c7dc-20ff-4d6d-989b-e8ae8e670611 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:23.085328 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a768c7dc-20ff-4d6d-989b-e8ae8e670611 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:23.086128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a768c7dc-20ff-4d6d-989b-e8ae8e670611 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:23.086552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a768c7dc-20ff-4d6d-989b-e8ae8e670611 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:23.279286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a768c7dc-20ff-4d6d-989b-e8ae8e670611 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:23.286633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a768c7dc-20ff-4d6d-989b-e8ae8e670611 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.213774 Aug 04 14:06:23.287202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 663/1294] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:23 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:23.750526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f2938213-a6e2-4966-9c3c-27d5f8a477b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:23.751440 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f2938213-a6e2-4966-9c3c-27d5f8a477b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:23.759711 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f2938213-a6e2-4966-9c3c-27d5f8a477b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:23.760180 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f2938213-a6e2-4966-9c3c-27d5f8a477b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:23.760998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f2938213-a6e2-4966-9c3c-27d5f8a477b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:23.761638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f2938213-a6e2-4966-9c3c-27d5f8a477b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:23.817932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ed6ae678-deda-420c-a60c-d47e2c85f26b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:23.818843 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ed6ae678-deda-420c-a60c-d47e2c85f26b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:23.824824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ed6ae678-deda-420c-a60c-d47e2c85f26b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:23.825266 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ed6ae678-deda-420c-a60c-d47e2c85f26b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:23.826035 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ed6ae678-deda-420c-a60c-d47e2c85f26b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:23.826461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ed6ae678-deda-420c-a60c-d47e2c85f26b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:23.969650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f2938213-a6e2-4966-9c3c-27d5f8a477b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 27778 microversion: 2.1 time: 0.222653 Aug 04 14:06:23.970602 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 632/1295] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:23 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 27778 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:24.003155 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ed6ae678-deda-420c-a60c-d47e2c85f26b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.189279 Aug 04 14:06:24.004425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 664/1296] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:23 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:24.304559 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-514b1727-29b7-465f-bc03-94f032b899e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:24.305159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-514b1727-29b7-465f-bc03-94f032b899e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:24.311542 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-514b1727-29b7-465f-bc03-94f032b899e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:24.311987 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-514b1727-29b7-465f-bc03-94f032b899e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:24.312769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-514b1727-29b7-465f-bc03-94f032b899e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:24.313196 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-514b1727-29b7-465f-bc03-94f032b899e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:24.437063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-514b1727-29b7-465f-bc03-94f032b899e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:24.444200 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-514b1727-29b7-465f-bc03-94f032b899e3 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.144370 Aug 04 14:06:24.444782 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 633/1297] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:24 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:24.981973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5963ddbc-fb3d-4a1b-a06f-c7eadbfd3aa9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:24.982977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5963ddbc-fb3d-4a1b-a06f-c7eadbfd3aa9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:24.989871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5963ddbc-fb3d-4a1b-a06f-c7eadbfd3aa9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:24.990312 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5963ddbc-fb3d-4a1b-a06f-c7eadbfd3aa9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:24.991078 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5963ddbc-fb3d-4a1b-a06f-c7eadbfd3aa9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:24.991499 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5963ddbc-fb3d-4a1b-a06f-c7eadbfd3aa9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:25.015804 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-90187855-9263-43bd-aa3a-c5ac6ec2f302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:25.016771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-90187855-9263-43bd-aa3a-c5ac6ec2f302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:25.023218 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90187855-9263-43bd-aa3a-c5ac6ec2f302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:25.023653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90187855-9263-43bd-aa3a-c5ac6ec2f302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:25.024448 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90187855-9263-43bd-aa3a-c5ac6ec2f302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:25.024877 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90187855-9263-43bd-aa3a-c5ac6ec2f302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:25.151895 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5963ddbc-fb3d-4a1b-a06f-c7eadbfd3aa9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28085 microversion: 2.1 time: 0.173723 Aug 04 14:06:25.152617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 665/1298] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:24 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28085 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:25.183849 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-90187855-9263-43bd-aa3a-c5ac6ec2f302 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.171541 Aug 04 14:06:25.184521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 634/1299] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:25 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:25.461659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-de452536-354d-481c-892e-4979918f0f35 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:25.462354 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-de452536-354d-481c-892e-4979918f0f35 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:25.468951 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de452536-354d-481c-892e-4979918f0f35 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:25.469399 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de452536-354d-481c-892e-4979918f0f35 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:25.470165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de452536-354d-481c-892e-4979918f0f35 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:25.470595 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-de452536-354d-481c-892e-4979918f0f35 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:25.600235 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-de452536-354d-481c-892e-4979918f0f35 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:25.608537 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-de452536-354d-481c-892e-4979918f0f35 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.150883 Aug 04 14:06:25.609152 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 666/1300] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:25 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:26.165706 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d68f2011-07f4-48da-96e5-0025430a2110 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:26.166608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d68f2011-07f4-48da-96e5-0025430a2110 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:26.173149 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d68f2011-07f4-48da-96e5-0025430a2110 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:26.173596 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d68f2011-07f4-48da-96e5-0025430a2110 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:26.174365 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d68f2011-07f4-48da-96e5-0025430a2110 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:26.174796 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d68f2011-07f4-48da-96e5-0025430a2110 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:26.195342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-db4ffecd-e21e-41dc-bb6d-6ad9c78484fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:26.196436 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-db4ffecd-e21e-41dc-bb6d-6ad9c78484fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:26.202468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-db4ffecd-e21e-41dc-bb6d-6ad9c78484fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:26.202901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-db4ffecd-e21e-41dc-bb6d-6ad9c78484fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:26.203659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-db4ffecd-e21e-41dc-bb6d-6ad9c78484fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:26.204086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-db4ffecd-e21e-41dc-bb6d-6ad9c78484fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:26.303083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d68f2011-07f4-48da-96e5-0025430a2110 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.141345 Aug 04 14:06:26.303734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 635/1301] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:26 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:26.317094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-db4ffecd-e21e-41dc-bb6d-6ad9c78484fc tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.125575 Aug 04 14:06:26.317729 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 667/1302] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:26 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:26.627030 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-dfcba479-649d-4d45-b151-2cf125eb4b31 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:26.627713 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-dfcba479-649d-4d45-b151-2cf125eb4b31 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:26.635097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dfcba479-649d-4d45-b151-2cf125eb4b31 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:26.635541 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dfcba479-649d-4d45-b151-2cf125eb4b31 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:26.636336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dfcba479-649d-4d45-b151-2cf125eb4b31 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:26.636767 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-dfcba479-649d-4d45-b151-2cf125eb4b31 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:26.756981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-dfcba479-649d-4d45-b151-2cf125eb4b31 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:26.764151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-dfcba479-649d-4d45-b151-2cf125eb4b31 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.141182 Aug 04 14:06:26.764738 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 636/1303] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:26 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:27.315104 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0454d12c-36e6-43e8-bb1b-9ea48f699569 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:27.316756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0454d12c-36e6-43e8-bb1b-9ea48f699569 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:27.323668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0454d12c-36e6-43e8-bb1b-9ea48f699569 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:27.324233 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0454d12c-36e6-43e8-bb1b-9ea48f699569 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:27.324937 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0454d12c-36e6-43e8-bb1b-9ea48f699569 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:27.325367 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0454d12c-36e6-43e8-bb1b-9ea48f699569 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:27.327904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5c9c9f03-3599-4304-8510-bfe0412a9e13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:27.328896 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5c9c9f03-3599-4304-8510-bfe0412a9e13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:27.335547 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c9c9f03-3599-4304-8510-bfe0412a9e13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:27.335999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c9c9f03-3599-4304-8510-bfe0412a9e13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:27.336852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c9c9f03-3599-4304-8510-bfe0412a9e13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:27.337284 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5c9c9f03-3599-4304-8510-bfe0412a9e13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:27.431953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0454d12c-36e6-43e8-bb1b-9ea48f699569 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.120715 Aug 04 14:06:27.432879 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 668/1304] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:27 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:27.455842 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5c9c9f03-3599-4304-8510-bfe0412a9e13 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.131818 Aug 04 14:06:27.456710 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 637/1305] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:27 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:27.781126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-67e42166-0593-4f6d-9e6c-1f02d8c56e7b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:27.781810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-67e42166-0593-4f6d-9e6c-1f02d8c56e7b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:27.788991 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67e42166-0593-4f6d-9e6c-1f02d8c56e7b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:27.789434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67e42166-0593-4f6d-9e6c-1f02d8c56e7b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:27.790190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67e42166-0593-4f6d-9e6c-1f02d8c56e7b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:27.790629 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67e42166-0593-4f6d-9e6c-1f02d8c56e7b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:27.910657 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-67e42166-0593-4f6d-9e6c-1f02d8c56e7b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:27.917927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-67e42166-0593-4f6d-9e6c-1f02d8c56e7b tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.140863 Aug 04 14:06:27.918485 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 669/1306] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:27 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:28.448901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-516ae17e-259a-4796-8281-60590c23fe92 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:28.449905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-516ae17e-259a-4796-8281-60590c23fe92 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:28.456525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-516ae17e-259a-4796-8281-60590c23fe92 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:28.457002 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-516ae17e-259a-4796-8281-60590c23fe92 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:28.457836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-516ae17e-259a-4796-8281-60590c23fe92 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:28.458271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-516ae17e-259a-4796-8281-60590c23fe92 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:28.468175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bfd7b7c1-9e3d-4d7c-b60d-fd4d6f35781d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:28.469171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bfd7b7c1-9e3d-4d7c-b60d-fd4d6f35781d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:28.475247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bfd7b7c1-9e3d-4d7c-b60d-fd4d6f35781d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:28.475695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bfd7b7c1-9e3d-4d7c-b60d-fd4d6f35781d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:28.478175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bfd7b7c1-9e3d-4d7c-b60d-fd4d6f35781d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:28.478175 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bfd7b7c1-9e3d-4d7c-b60d-fd4d6f35781d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:28.556716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-516ae17e-259a-4796-8281-60590c23fe92 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.116436 Aug 04 14:06:28.557381 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 638/1307] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:28 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:28.592925 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bfd7b7c1-9e3d-4d7c-b60d-fd4d6f35781d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.128304 Aug 04 14:06:28.593565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 670/1308] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:28 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:28.935387 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-13944a15-0186-46e6-a283-4bc9a7f97467 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:28.936066 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-13944a15-0186-46e6-a283-4bc9a7f97467 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:28.942558 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-13944a15-0186-46e6-a283-4bc9a7f97467 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:28.942976 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-13944a15-0186-46e6-a283-4bc9a7f97467 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:28.943732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-13944a15-0186-46e6-a283-4bc9a7f97467 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:28.944155 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-13944a15-0186-46e6-a283-4bc9a7f97467 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:29.068695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-13944a15-0186-46e6-a283-4bc9a7f97467 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:29.076315 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-13944a15-0186-46e6-a283-4bc9a7f97467 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.145004 Aug 04 14:06:29.076886 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 639/1309] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:28 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:29.569397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1a58ad14-4d03-4b5e-ab87-2b8a728a77fc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:29.570385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1a58ad14-4d03-4b5e-ab87-2b8a728a77fc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:29.577138 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a58ad14-4d03-4b5e-ab87-2b8a728a77fc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:29.577584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a58ad14-4d03-4b5e-ab87-2b8a728a77fc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:29.578350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a58ad14-4d03-4b5e-ab87-2b8a728a77fc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:29.578780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1a58ad14-4d03-4b5e-ab87-2b8a728a77fc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:29.604693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d06b0218-6b39-42f1-8b1c-0a42f1b42b59 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:29.605513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d06b0218-6b39-42f1-8b1c-0a42f1b42b59 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:29.611744 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d06b0218-6b39-42f1-8b1c-0a42f1b42b59 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:29.612184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d06b0218-6b39-42f1-8b1c-0a42f1b42b59 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:29.613745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d06b0218-6b39-42f1-8b1c-0a42f1b42b59 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:29.614171 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d06b0218-6b39-42f1-8b1c-0a42f1b42b59 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:29.713453 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1a58ad14-4d03-4b5e-ab87-2b8a728a77fc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.148647 Aug 04 14:06:29.714097 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 671/1310] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:29 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:29.742111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d06b0218-6b39-42f1-8b1c-0a42f1b42b59 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.140963 Aug 04 14:06:29.742944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 640/1311] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:29 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:30.093155 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7716ef83-669e-47c7-aef0-8c34a2b40808 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:30.093845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7716ef83-669e-47c7-aef0-8c34a2b40808 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:30.100287 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7716ef83-669e-47c7-aef0-8c34a2b40808 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:30.100733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7716ef83-669e-47c7-aef0-8c34a2b40808 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:30.101494 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7716ef83-669e-47c7-aef0-8c34a2b40808 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:30.101927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7716ef83-669e-47c7-aef0-8c34a2b40808 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:30.226550 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7716ef83-669e-47c7-aef0-8c34a2b40808 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:30.233856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7716ef83-669e-47c7-aef0-8c34a2b40808 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.144736 Aug 04 14:06:30.234415 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 672/1312] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:30 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:30.725973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-44aa50d2-4b0e-42d3-a3ff-89279d3f7069 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:30.727046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-44aa50d2-4b0e-42d3-a3ff-89279d3f7069 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:30.733358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-44aa50d2-4b0e-42d3-a3ff-89279d3f7069 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:30.733828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-44aa50d2-4b0e-42d3-a3ff-89279d3f7069 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:30.734580 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-44aa50d2-4b0e-42d3-a3ff-89279d3f7069 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:30.735005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-44aa50d2-4b0e-42d3-a3ff-89279d3f7069 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:30.754295 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c2da05b2-75ce-4017-bffc-a7eba2e5ead1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:30.755200 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c2da05b2-75ce-4017-bffc-a7eba2e5ead1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:30.761008 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2da05b2-75ce-4017-bffc-a7eba2e5ead1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:30.761458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2da05b2-75ce-4017-bffc-a7eba2e5ead1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:30.762228 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2da05b2-75ce-4017-bffc-a7eba2e5ead1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:30.762657 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c2da05b2-75ce-4017-bffc-a7eba2e5ead1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:30.917061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c2da05b2-75ce-4017-bffc-a7eba2e5ead1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.166893 Aug 04 14:06:30.917723 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 673/1313] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:30 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:30.933309 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-44aa50d2-4b0e-42d3-a3ff-89279d3f7069 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.211619 Aug 04 14:06:30.933953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 641/1314] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:30 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:31.251425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1fced6ce-44c3-4c35-b4db-e02afaaa83ec tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:31.252118 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1fced6ce-44c3-4c35-b4db-e02afaaa83ec tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:31.258670 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1fced6ce-44c3-4c35-b4db-e02afaaa83ec tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:31.259117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1fced6ce-44c3-4c35-b4db-e02afaaa83ec tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:31.259877 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1fced6ce-44c3-4c35-b4db-e02afaaa83ec tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:31.260330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1fced6ce-44c3-4c35-b4db-e02afaaa83ec tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:31.383741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1fced6ce-44c3-4c35-b4db-e02afaaa83ec tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:31.392180 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1fced6ce-44c3-4c35-b4db-e02afaaa83ec tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.144747 Aug 04 14:06:31.392999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 674/1315] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:31 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:31.929204 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ed05b0fd-ed79-4cf5-b87d-8c9de9165b4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:31.930197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ed05b0fd-ed79-4cf5-b87d-8c9de9165b4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:31.936677 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ed05b0fd-ed79-4cf5-b87d-8c9de9165b4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:31.937126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ed05b0fd-ed79-4cf5-b87d-8c9de9165b4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:31.937886 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ed05b0fd-ed79-4cf5-b87d-8c9de9165b4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:31.938316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ed05b0fd-ed79-4cf5-b87d-8c9de9165b4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:31.945094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fdaddb0c-1283-42b0-a806-5bc92e21e5b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:31.946034 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fdaddb0c-1283-42b0-a806-5bc92e21e5b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:31.951953 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fdaddb0c-1283-42b0-a806-5bc92e21e5b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:31.952448 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fdaddb0c-1283-42b0-a806-5bc92e21e5b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:31.953249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fdaddb0c-1283-42b0-a806-5bc92e21e5b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:31.953667 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fdaddb0c-1283-42b0-a806-5bc92e21e5b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:32.057413 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ed05b0fd-ed79-4cf5-b87d-8c9de9165b4f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.131301 Aug 04 14:06:32.058064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 642/1316] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:31 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:32.075073 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fdaddb0c-1283-42b0-a806-5bc92e21e5b7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.133634 Aug 04 14:06:32.076198 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 675/1317] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:31 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:06:32.411009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1968070f-0ddc-40c3-9c72-27a9cb4ef0cf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:32.411704 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1968070f-0ddc-40c3-9c72-27a9cb4ef0cf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:32.418103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1968070f-0ddc-40c3-9c72-27a9cb4ef0cf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:32.418548 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1968070f-0ddc-40c3-9c72-27a9cb4ef0cf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:32.419307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1968070f-0ddc-40c3-9c72-27a9cb4ef0cf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:32.419736 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1968070f-0ddc-40c3-9c72-27a9cb4ef0cf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:32.541256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1968070f-0ddc-40c3-9c72-27a9cb4ef0cf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:32.548424 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1968070f-0ddc-40c3-9c72-27a9cb4ef0cf tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.141567 Aug 04 14:06:32.548989 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 643/1318] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:32 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:33.070243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-34d75c7f-5a98-4083-9a27-4655522231da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:33.071960 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-34d75c7f-5a98-4083-9a27-4655522231da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:33.078751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-34d75c7f-5a98-4083-9a27-4655522231da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:33.079190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-34d75c7f-5a98-4083-9a27-4655522231da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:33.079946 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-34d75c7f-5a98-4083-9a27-4655522231da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:33.080433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-34d75c7f-5a98-4083-9a27-4655522231da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:33.086963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9d44cb28-0917-4441-b400-04002798e106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:33.087865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9d44cb28-0917-4441-b400-04002798e106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:33.093613 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d44cb28-0917-4441-b400-04002798e106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:33.094065 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d44cb28-0917-4441-b400-04002798e106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:33.094833 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d44cb28-0917-4441-b400-04002798e106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:33.095265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9d44cb28-0917-4441-b400-04002798e106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:33.202113 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-34d75c7f-5a98-4083-9a27-4655522231da tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.135674 Aug 04 14:06:33.202751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 676/1319] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:33 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:33.223260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9d44cb28-0917-4441-b400-04002798e106 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.139754 Aug 04 14:06:33.223942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 644/1320] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:33 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:06:33.565974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-73c962eb-22a8-4bd1-9829-066ae4234336 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:33.566744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-73c962eb-22a8-4bd1-9829-066ae4234336 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:33.573292 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-73c962eb-22a8-4bd1-9829-066ae4234336 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:33.574005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-73c962eb-22a8-4bd1-9829-066ae4234336 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:33.574770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-73c962eb-22a8-4bd1-9829-066ae4234336 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:33.575199 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-73c962eb-22a8-4bd1-9829-066ae4234336 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:33.867871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-73c962eb-22a8-4bd1-9829-066ae4234336 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:33.875173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-73c962eb-22a8-4bd1-9829-066ae4234336 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.313422 Aug 04 14:06:33.875741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 677/1321] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:33 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:34.214510 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6cd02583-41e5-4eba-a9b1-fef9b403105a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:34.215513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6cd02583-41e5-4eba-a9b1-fef9b403105a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:34.222398 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6cd02583-41e5-4eba-a9b1-fef9b403105a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:34.222846 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6cd02583-41e5-4eba-a9b1-fef9b403105a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:34.223603 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6cd02583-41e5-4eba-a9b1-fef9b403105a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:34.224027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6cd02583-41e5-4eba-a9b1-fef9b403105a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:34.234286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-83319528-226e-4630-8b86-4ca520e7fe40 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:34.235325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-83319528-226e-4630-8b86-4ca520e7fe40 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:34.242590 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-83319528-226e-4630-8b86-4ca520e7fe40 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:34.243033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-83319528-226e-4630-8b86-4ca520e7fe40 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:34.243795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-83319528-226e-4630-8b86-4ca520e7fe40 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:34.244250 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-83319528-226e-4630-8b86-4ca520e7fe40 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:34.339665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6cd02583-41e5-4eba-a9b1-fef9b403105a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.128986 Aug 04 14:06:34.340346 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 645/1322] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:34 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:34.354900 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-83319528-226e-4630-8b86-4ca520e7fe40 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.124051 Aug 04 14:06:34.355885 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 678/1323] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:34 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:34.893096 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6cd16480-8cc4-47dc-a356-66c0b98feee6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:34.894628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6cd16480-8cc4-47dc-a356-66c0b98feee6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:34.901312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6cd16480-8cc4-47dc-a356-66c0b98feee6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:34.901753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6cd16480-8cc4-47dc-a356-66c0b98feee6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:34.902516 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6cd16480-8cc4-47dc-a356-66c0b98feee6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:34.902946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6cd16480-8cc4-47dc-a356-66c0b98feee6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:35.074257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6cd16480-8cc4-47dc-a356-66c0b98feee6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:35.082162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6cd16480-8cc4-47dc-a356-66c0b98feee6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.192402 Aug 04 14:06:35.082748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 646/1324] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:34 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:35.351544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7d53de06-df37-423b-bb53-5f64ebc9fc86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:35.353215 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7d53de06-df37-423b-bb53-5f64ebc9fc86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:35.359733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d53de06-df37-423b-bb53-5f64ebc9fc86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:35.360171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d53de06-df37-423b-bb53-5f64ebc9fc86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:35.361020 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d53de06-df37-423b-bb53-5f64ebc9fc86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:35.361443 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d53de06-df37-423b-bb53-5f64ebc9fc86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:35.366772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-67e6a138-d589-458b-86f7-cac2117092a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:35.367686 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-67e6a138-d589-458b-86f7-cac2117092a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:35.373474 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67e6a138-d589-458b-86f7-cac2117092a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:35.373925 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67e6a138-d589-458b-86f7-cac2117092a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:35.374696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67e6a138-d589-458b-86f7-cac2117092a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:35.375129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67e6a138-d589-458b-86f7-cac2117092a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:35.486233 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7d53de06-df37-423b-bb53-5f64ebc9fc86 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.138628 Aug 04 14:06:35.487131 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 679/1325] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:35 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:35.503638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-67e6a138-d589-458b-86f7-cac2117092a9 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.139795 Aug 04 14:06:35.504585 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 647/1326] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:35 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:36.099422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3c476600-807e-423b-b181-1c029dc6cfe1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:36.100114 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3c476600-807e-423b-b181-1c029dc6cfe1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:36.106547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3c476600-807e-423b-b181-1c029dc6cfe1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:36.106987 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3c476600-807e-423b-b181-1c029dc6cfe1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:36.107751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3c476600-807e-423b-b181-1c029dc6cfe1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:36.108174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3c476600-807e-423b-b181-1c029dc6cfe1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:36.245088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-3c476600-807e-423b-b181-1c029dc6cfe1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:36.252306 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3c476600-807e-423b-b181-1c029dc6cfe1 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.157191 Aug 04 14:06:36.252867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 680/1327] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:36 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:36.498257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-678f92e7-faab-406b-b3aa-8bd76705c9e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:36.499222 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-678f92e7-faab-406b-b3aa-8bd76705c9e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:36.506338 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-678f92e7-faab-406b-b3aa-8bd76705c9e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:36.506778 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-678f92e7-faab-406b-b3aa-8bd76705c9e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:36.507533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-678f92e7-faab-406b-b3aa-8bd76705c9e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:36.507956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-678f92e7-faab-406b-b3aa-8bd76705c9e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:36.514743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2f3e26bf-4979-4b05-a7da-2f39c712a67e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:36.515641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2f3e26bf-4979-4b05-a7da-2f39c712a67e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:36.522608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2f3e26bf-4979-4b05-a7da-2f39c712a67e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:36.523047 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2f3e26bf-4979-4b05-a7da-2f39c712a67e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:36.523993 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2f3e26bf-4979-4b05-a7da-2f39c712a67e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:36.524477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2f3e26bf-4979-4b05-a7da-2f39c712a67e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:36.610757 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-678f92e7-faab-406b-b3aa-8bd76705c9e1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.116323 Aug 04 14:06:36.611647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 648/1328] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:36 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:36.648570 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2f3e26bf-4979-4b05-a7da-2f39c712a67e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.137142 Aug 04 14:06:36.649211 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 681/1329] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:36 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:37.271838 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-26dd2d94-05b1-4a32-bc14-aba2df1df350 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:37.272565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-26dd2d94-05b1-4a32-bc14-aba2df1df350 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:37.279277 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-26dd2d94-05b1-4a32-bc14-aba2df1df350 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:37.279721 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-26dd2d94-05b1-4a32-bc14-aba2df1df350 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:37.280509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-26dd2d94-05b1-4a32-bc14-aba2df1df350 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:37.280942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-26dd2d94-05b1-4a32-bc14-aba2df1df350 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:37.407123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-26dd2d94-05b1-4a32-bc14-aba2df1df350 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:37.414478 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-26dd2d94-05b1-4a32-bc14-aba2df1df350 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.146748 Aug 04 14:06:37.415053 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 649/1330] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:37 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:37.623330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e20ecbb6-6008-4704-bf32-bc3fc53905cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:37.624346 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e20ecbb6-6008-4704-bf32-bc3fc53905cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:37.631502 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e20ecbb6-6008-4704-bf32-bc3fc53905cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:37.632004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e20ecbb6-6008-4704-bf32-bc3fc53905cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:37.632870 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e20ecbb6-6008-4704-bf32-bc3fc53905cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:37.633248 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e20ecbb6-6008-4704-bf32-bc3fc53905cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:37.661850 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-90b878ad-fd28-413c-9e71-e5c5d9c010aa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:37.662913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-90b878ad-fd28-413c-9e71-e5c5d9c010aa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:37.668751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90b878ad-fd28-413c-9e71-e5c5d9c010aa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:37.669276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90b878ad-fd28-413c-9e71-e5c5d9c010aa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:37.670125 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90b878ad-fd28-413c-9e71-e5c5d9c010aa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:37.670629 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-90b878ad-fd28-413c-9e71-e5c5d9c010aa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:37.763227 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e20ecbb6-6008-4704-bf32-bc3fc53905cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.143737 Aug 04 14:06:37.763972 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 682/1331] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:37 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:37.769833 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-9534517f-ba84-416d-8950-a86ababf1db6 req-0649d968-20f2-464e-9352-31cec36262aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f294abe-0e93-4c4a-a576-256d5711a5ec", "name": "network-vif-plugged", "status": "completed", "tag": "0d3ac144-6427-446d-ba0f-bfa1b99ceb8f"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:37.771308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:06:37.771308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:06:37.778734 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-9534517f-ba84-416d-8950-a86ababf1db6 req-0649d968-20f2-464e-9352-31cec36262aa service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:37.779493 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-9534517f-ba84-416d-8950-a86ababf1db6 req-0649d968-20f2-464e-9352-31cec36262aa service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:37.790881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-90b878ad-fd28-413c-9e71-e5c5d9c010aa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.134355 Aug 04 14:06:37.791690 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 650/1332] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:37 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:06:37.791857 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-9534517f-ba84-416d-8950-a86ababf1db6 req-0649d968-20f2-464e-9352-31cec36262aa service nova] Creating event network-vif-plugged:0d3ac144-6427-446d-ba0f-bfa1b99ceb8f for instance 4f294abe-0e93-4c4a-a576-256d5711a5ec on hv-cinder-79264 Aug 04 14:06:37.796552 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-9534517f-ba84-416d-8950-a86ababf1db6 req-0649d968-20f2-464e-9352-31cec36262aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031154 Aug 04 14:06:37.797136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 683/1333] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:06:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:38.431544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a6e8af24-be3e-4524-8d48-1d503d6b8219 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:38.432265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a6e8af24-be3e-4524-8d48-1d503d6b8219 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:38.438650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6e8af24-be3e-4524-8d48-1d503d6b8219 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:38.439092 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6e8af24-be3e-4524-8d48-1d503d6b8219 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:38.439847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6e8af24-be3e-4524-8d48-1d503d6b8219 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:38.440294 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6e8af24-be3e-4524-8d48-1d503d6b8219 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:38.562266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a6e8af24-be3e-4524-8d48-1d503d6b8219 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:38.570520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a6e8af24-be3e-4524-8d48-1d503d6b8219 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.142998 Aug 04 14:06:38.571094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 651/1334] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:38 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:38.775850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e8f68eb6-61e2-49ab-9d5c-5b7251a8b94c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:38.776841 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e8f68eb6-61e2-49ab-9d5c-5b7251a8b94c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:38.783327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8f68eb6-61e2-49ab-9d5c-5b7251a8b94c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:38.783772 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8f68eb6-61e2-49ab-9d5c-5b7251a8b94c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:38.784572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8f68eb6-61e2-49ab-9d5c-5b7251a8b94c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:38.784999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8f68eb6-61e2-49ab-9d5c-5b7251a8b94c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:38.803289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0c9691cf-1619-4c46-bfdb-3b49d3189c00 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:38.804189 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0c9691cf-1619-4c46-bfdb-3b49d3189c00 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:38.809877 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0c9691cf-1619-4c46-bfdb-3b49d3189c00 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:38.810318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0c9691cf-1619-4c46-bfdb-3b49d3189c00 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:38.811092 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0c9691cf-1619-4c46-bfdb-3b49d3189c00 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:38.811522 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0c9691cf-1619-4c46-bfdb-3b49d3189c00 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:39.032569 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0c9691cf-1619-4c46-bfdb-3b49d3189c00 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.233151 Aug 04 14:06:39.033163 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 652/1335] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:38 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:06:39.053882 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e8f68eb6-61e2-49ab-9d5c-5b7251a8b94c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.281890 Aug 04 14:06:39.054514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 684/1336] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:38 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:39.588070 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fbeac670-d4e3-4cbe-ac8b-21df25a4d107 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:39.588811 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-fbeac670-d4e3-4cbe-ac8b-21df25a4d107 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:39.595227 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbeac670-d4e3-4cbe-ac8b-21df25a4d107 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:39.595673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbeac670-d4e3-4cbe-ac8b-21df25a4d107 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:39.596478 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbeac670-d4e3-4cbe-ac8b-21df25a4d107 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:39.597590 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-fbeac670-d4e3-4cbe-ac8b-21df25a4d107 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:39.717634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-fbeac670-d4e3-4cbe-ac8b-21df25a4d107 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:39.725605 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fbeac670-d4e3-4cbe-ac8b-21df25a4d107 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1266 microversion: 2.1 time: 0.141417 Aug 04 14:06:39.726070 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 653/1337] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:39 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:40.044692 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f27ec4a5-a737-4544-91be-f8bcaac9a322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:40.045670 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f27ec4a5-a737-4544-91be-f8bcaac9a322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:40.052191 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f27ec4a5-a737-4544-91be-f8bcaac9a322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:40.052669 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f27ec4a5-a737-4544-91be-f8bcaac9a322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:40.053427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f27ec4a5-a737-4544-91be-f8bcaac9a322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:40.053880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f27ec4a5-a737-4544-91be-f8bcaac9a322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:40.065904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3804da62-37b2-454d-9487-ed9012efa839 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:40.066821 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3804da62-37b2-454d-9487-ed9012efa839 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:40.072575 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3804da62-37b2-454d-9487-ed9012efa839 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:40.073031 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3804da62-37b2-454d-9487-ed9012efa839 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:40.074073 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3804da62-37b2-454d-9487-ed9012efa839 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:40.074511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3804da62-37b2-454d-9487-ed9012efa839 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:40.176594 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f27ec4a5-a737-4544-91be-f8bcaac9a322 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.135527 Aug 04 14:06:40.178767 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 685/1338] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:40 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:40.235198 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3804da62-37b2-454d-9487-ed9012efa839 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.173326 Aug 04 14:06:40.235841 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 654/1339] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:40 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:40.743115 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-989fbee1-68f2-4c15-99a2-fb86e19eb36e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:40.743802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-989fbee1-68f2-4c15-99a2-fb86e19eb36e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:40.750141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-989fbee1-68f2-4c15-99a2-fb86e19eb36e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:40.750609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-989fbee1-68f2-4c15-99a2-fb86e19eb36e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:40.751362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-989fbee1-68f2-4c15-99a2-fb86e19eb36e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:40.751791 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-989fbee1-68f2-4c15-99a2-fb86e19eb36e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:40.872730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-989fbee1-68f2-4c15-99a2-fb86e19eb36e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:40.880543 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-989fbee1-68f2-4c15-99a2-fb86e19eb36e tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1453 microversion: 2.1 time: 0.141387 Aug 04 14:06:40.881107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 686/1340] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:40 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:40.896958 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-022c4839-4c7a-4dac-a061-2cd087a8d0f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:40.897644 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-022c4839-4c7a-4dac-a061-2cd087a8d0f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:40.904078 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-022c4839-4c7a-4dac-a061-2cd087a8d0f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:40.904567 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-022c4839-4c7a-4dac-a061-2cd087a8d0f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:40.905339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-022c4839-4c7a-4dac-a061-2cd087a8d0f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:40.905766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-022c4839-4c7a-4dac-a061-2cd087a8d0f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:41.031043 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-022c4839-4c7a-4dac-a061-2cd087a8d0f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:41.039190 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-022c4839-4c7a-4dac-a061-2cd087a8d0f6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1453 microversion: 2.1 time: 0.146393 Aug 04 14:06:41.039759 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 655/1341] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:06:40 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:41.187413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1f1eb81b-35bd-495f-8921-0be8df65772a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:41.188457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1f1eb81b-35bd-495f-8921-0be8df65772a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:41.195087 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f1eb81b-35bd-495f-8921-0be8df65772a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:41.195538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f1eb81b-35bd-495f-8921-0be8df65772a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:41.196409 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f1eb81b-35bd-495f-8921-0be8df65772a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:41.196850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f1eb81b-35bd-495f-8921-0be8df65772a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:41.247843 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b43948fb-da01-4535-b3f6-9ca95b7161ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:41.248861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b43948fb-da01-4535-b3f6-9ca95b7161ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:41.254975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b43948fb-da01-4535-b3f6-9ca95b7161ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:41.255414 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b43948fb-da01-4535-b3f6-9ca95b7161ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:41.256266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b43948fb-da01-4535-b3f6-9ca95b7161ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:41.256705 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b43948fb-da01-4535-b3f6-9ca95b7161ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:41.337565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1f1eb81b-35bd-495f-8921-0be8df65772a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.153784 Aug 04 14:06:41.341440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 687/1342] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:41 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:41.390720 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b43948fb-da01-4535-b3f6-9ca95b7161ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.146320 Aug 04 14:06:41.391662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 656/1343] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:41 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:42.350585 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-59dcc708-5634-4875-a0b0-8d998c5019ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:42.352537 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-59dcc708-5634-4875-a0b0-8d998c5019ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:42.359148 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-59dcc708-5634-4875-a0b0-8d998c5019ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:42.359598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-59dcc708-5634-4875-a0b0-8d998c5019ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:42.360432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-59dcc708-5634-4875-a0b0-8d998c5019ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:42.360887 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-59dcc708-5634-4875-a0b0-8d998c5019ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:42.402896 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5718197a-0a99-459a-a304-76454d4d2532 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:42.403883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5718197a-0a99-459a-a304-76454d4d2532 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:42.410922 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5718197a-0a99-459a-a304-76454d4d2532 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:42.411370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5718197a-0a99-459a-a304-76454d4d2532 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:42.412146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5718197a-0a99-459a-a304-76454d4d2532 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:42.412609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5718197a-0a99-459a-a304-76454d4d2532 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:42.479848 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-59dcc708-5634-4875-a0b0-8d998c5019ab tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.134014 Aug 04 14:06:42.480634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 688/1344] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:42 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:42.574956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5718197a-0a99-459a-a304-76454d4d2532 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.175911 Aug 04 14:06:42.578748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 657/1345] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:42 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:42.745202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-285b2a72-f3dd-4ecc-9a7f-a71d3278ac4e req-d7cc88eb-b17d-4ae5-86af-6f881e2c4eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f294abe-0e93-4c4a-a576-256d5711a5ec", "tag": "0d3ac144-6427-446d-ba0f-bfa1b99ceb8f"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:42.746710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:06:42.746710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:06:42.754438 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-285b2a72-f3dd-4ecc-9a7f-a71d3278ac4e req-d7cc88eb-b17d-4ae5-86af-6f881e2c4eef service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:42.754880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-285b2a72-f3dd-4ecc-9a7f-a71d3278ac4e req-d7cc88eb-b17d-4ae5-86af-6f881e2c4eef service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:42.765867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-285b2a72-f3dd-4ecc-9a7f-a71d3278ac4e req-d7cc88eb-b17d-4ae5-86af-6f881e2c4eef service nova] Creating event network-changed:0d3ac144-6427-446d-ba0f-bfa1b99ceb8f for instance 4f294abe-0e93-4c4a-a576-256d5711a5ec on hv-cinder-79264 Aug 04 14:06:42.771237 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-285b2a72-f3dd-4ecc-9a7f-a71d3278ac4e req-d7cc88eb-b17d-4ae5-86af-6f881e2c4eef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029959 Aug 04 14:06:42.772052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 689/1346] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:06:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:43.492895 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e9124ee8-dc7d-4324-b512-b811d119cbcd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:43.493924 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e9124ee8-dc7d-4324-b512-b811d119cbcd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:43.500292 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9124ee8-dc7d-4324-b512-b811d119cbcd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:43.500744 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9124ee8-dc7d-4324-b512-b811d119cbcd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:43.501512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9124ee8-dc7d-4324-b512-b811d119cbcd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:43.501942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e9124ee8-dc7d-4324-b512-b811d119cbcd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:43.587387 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-273bd5e5-83fd-4643-8d3e-4bf04ff623b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:43.588409 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-273bd5e5-83fd-4643-8d3e-4bf04ff623b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:43.593443 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e9124ee8-dc7d-4324-b512-b811d119cbcd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.104730 Aug 04 14:06:43.594106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 658/1347] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:43 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:43.595314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-273bd5e5-83fd-4643-8d3e-4bf04ff623b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:43.595932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-273bd5e5-83fd-4643-8d3e-4bf04ff623b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:43.597073 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-273bd5e5-83fd-4643-8d3e-4bf04ff623b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:43.597678 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-273bd5e5-83fd-4643-8d3e-4bf04ff623b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:43.685158 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-273bd5e5-83fd-4643-8d3e-4bf04ff623b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.101781 Aug 04 14:06:43.685812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 690/1348] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:43 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:44.605953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c511d4d6-0868-4222-9924-0c7bb5bb6d45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:44.608543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c511d4d6-0868-4222-9924-0c7bb5bb6d45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:44.614031 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c511d4d6-0868-4222-9924-0c7bb5bb6d45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:44.614509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c511d4d6-0868-4222-9924-0c7bb5bb6d45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:44.615287 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c511d4d6-0868-4222-9924-0c7bb5bb6d45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:44.615716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c511d4d6-0868-4222-9924-0c7bb5bb6d45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:44.698164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-225a8d2e-2dfc-4f4d-b9ac-faaea5ed240c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:44.699322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-225a8d2e-2dfc-4f4d-b9ac-faaea5ed240c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:44.705046 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c511d4d6-0868-4222-9924-0c7bb5bb6d45 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.103043 Aug 04 14:06:44.706024 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 659/1349] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:44 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:44.706762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-225a8d2e-2dfc-4f4d-b9ac-faaea5ed240c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:44.707206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-225a8d2e-2dfc-4f4d-b9ac-faaea5ed240c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:44.707977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-225a8d2e-2dfc-4f4d-b9ac-faaea5ed240c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:44.708434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-225a8d2e-2dfc-4f4d-b9ac-faaea5ed240c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:44.794075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-225a8d2e-2dfc-4f4d-b9ac-faaea5ed240c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.100006 Aug 04 14:06:44.794714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 691/1350] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:44 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:45.717366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4f146a70-a56a-4a92-ae6f-8e4dcff7fffa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:45.718575 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4f146a70-a56a-4a92-ae6f-8e4dcff7fffa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:45.726020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4f146a70-a56a-4a92-ae6f-8e4dcff7fffa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:45.726463 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4f146a70-a56a-4a92-ae6f-8e4dcff7fffa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:45.727244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4f146a70-a56a-4a92-ae6f-8e4dcff7fffa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:45.727669 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4f146a70-a56a-4a92-ae6f-8e4dcff7fffa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:45.806154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-41407207-11ee-47cb-ab94-8442f1c4b65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:45.807277 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-41407207-11ee-47cb-ab94-8442f1c4b65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:45.814104 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-41407207-11ee-47cb-ab94-8442f1c4b65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:45.814903 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-41407207-11ee-47cb-ab94-8442f1c4b65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:45.815671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-41407207-11ee-47cb-ab94-8442f1c4b65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:45.816261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-41407207-11ee-47cb-ab94-8442f1c4b65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:45.828770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4f146a70-a56a-4a92-ae6f-8e4dcff7fffa tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.115295 Aug 04 14:06:45.829699 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 660/1351] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:45 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:45.911703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-41407207-11ee-47cb-ab94-8442f1c4b65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.109554 Aug 04 14:06:45.912771 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 692/1352] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:45 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:46.841948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-badab5a7-d1ca-4703-acb8-b01a1e1e6e02 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:46.842975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-badab5a7-d1ca-4703-acb8-b01a1e1e6e02 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:46.849370 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-badab5a7-d1ca-4703-acb8-b01a1e1e6e02 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:46.849812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-badab5a7-d1ca-4703-acb8-b01a1e1e6e02 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:46.850565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-badab5a7-d1ca-4703-acb8-b01a1e1e6e02 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:46.850990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-badab5a7-d1ca-4703-acb8-b01a1e1e6e02 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:46.923388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-67fc8c81-ccff-4f94-b6c4-29b510398505 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:46.924421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-67fc8c81-ccff-4f94-b6c4-29b510398505 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:46.931040 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67fc8c81-ccff-4f94-b6c4-29b510398505 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:46.931474 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67fc8c81-ccff-4f94-b6c4-29b510398505 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:46.932248 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67fc8c81-ccff-4f94-b6c4-29b510398505 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:46.932676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-67fc8c81-ccff-4f94-b6c4-29b510398505 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:46.947252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-badab5a7-d1ca-4703-acb8-b01a1e1e6e02 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28269 microversion: 2.1 time: 0.109157 Aug 04 14:06:46.948154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 661/1353] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:46 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:47.046071 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-67fc8c81-ccff-4f94-b6c4-29b510398505 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.126517 Aug 04 14:06:47.046712 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 693/1354] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:46 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:47.959702 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d7c23656-0803-41fc-ac3f-25edbe9676b2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:47.960700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d7c23656-0803-41fc-ac3f-25edbe9676b2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:47.967100 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7c23656-0803-41fc-ac3f-25edbe9676b2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:47.967544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7c23656-0803-41fc-ac3f-25edbe9676b2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:47.968330 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7c23656-0803-41fc-ac3f-25edbe9676b2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:47.968759 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d7c23656-0803-41fc-ac3f-25edbe9676b2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:48.059038 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-077f8c7c-0b1e-410a-bfca-1fe3a8393310 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:48.060144 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-077f8c7c-0b1e-410a-bfca-1fe3a8393310 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:48.064298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d7c23656-0803-41fc-ac3f-25edbe9676b2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28560 microversion: 2.1 time: 0.108445 Aug 04 14:06:48.065038 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 662/1355] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:47 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28560 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:48.067337 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-077f8c7c-0b1e-410a-bfca-1fe3a8393310 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:48.067782 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-077f8c7c-0b1e-410a-bfca-1fe3a8393310 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:48.068709 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-077f8c7c-0b1e-410a-bfca-1fe3a8393310 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:48.069082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-077f8c7c-0b1e-410a-bfca-1fe3a8393310 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:48.155485 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-077f8c7c-0b1e-410a-bfca-1fe3a8393310 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.100286 Aug 04 14:06:48.156130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 694/1356] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:48 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:49.077948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d177c6ce-1cad-42ac-ae06-eee2c5fada71 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:49.078939 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d177c6ce-1cad-42ac-ae06-eee2c5fada71 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:49.086383 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d177c6ce-1cad-42ac-ae06-eee2c5fada71 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:49.086881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d177c6ce-1cad-42ac-ae06-eee2c5fada71 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:49.087783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d177c6ce-1cad-42ac-ae06-eee2c5fada71 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:49.088297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d177c6ce-1cad-42ac-ae06-eee2c5fada71 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:49.168499 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-58d81a40-d58c-4eb5-8133-f4410a4b7c2a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:49.169453 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-58d81a40-d58c-4eb5-8133-f4410a4b7c2a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:49.176116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58d81a40-d58c-4eb5-8133-f4410a4b7c2a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:49.176590 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58d81a40-d58c-4eb5-8133-f4410a4b7c2a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:49.177345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58d81a40-d58c-4eb5-8133-f4410a4b7c2a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:49.177770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-58d81a40-d58c-4eb5-8133-f4410a4b7c2a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:49.189755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d177c6ce-1cad-42ac-ae06-eee2c5fada71 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28560 microversion: 2.1 time: 0.115942 Aug 04 14:06:49.191082 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 663/1357] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:49 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28560 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:49.266233 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-58d81a40-d58c-4eb5-8133-f4410a4b7c2a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.101723 Aug 04 14:06:49.267056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 695/1358] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:49 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:50.203256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-984fe2b1-de8b-4235-b0f4-00563afb4073 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:50.204241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-984fe2b1-de8b-4235-b0f4-00563afb4073 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:50.211117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-984fe2b1-de8b-4235-b0f4-00563afb4073 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:50.211556 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-984fe2b1-de8b-4235-b0f4-00563afb4073 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:50.212338 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-984fe2b1-de8b-4235-b0f4-00563afb4073 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:50.212772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-984fe2b1-de8b-4235-b0f4-00563afb4073 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:50.279164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b6ff26c3-f5e7-43c1-8c62-d1b9cc9b66a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:50.280196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b6ff26c3-f5e7-43c1-8c62-d1b9cc9b66a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:50.287163 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b6ff26c3-f5e7-43c1-8c62-d1b9cc9b66a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:50.287640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b6ff26c3-f5e7-43c1-8c62-d1b9cc9b66a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:50.288434 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b6ff26c3-f5e7-43c1-8c62-d1b9cc9b66a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:50.289454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b6ff26c3-f5e7-43c1-8c62-d1b9cc9b66a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:50.316748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-984fe2b1-de8b-4235-b0f4-00563afb4073 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.117412 Aug 04 14:06:50.317427 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 664/1359] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:50 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:50.407323 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b6ff26c3-f5e7-43c1-8c62-d1b9cc9b66a7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.132094 Aug 04 14:06:50.407981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 696/1360] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:50 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:51.330024 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e4d4d3a2-3888-434a-994c-dbd032285673 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:51.330992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e4d4d3a2-3888-434a-994c-dbd032285673 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:51.339609 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e4d4d3a2-3888-434a-994c-dbd032285673 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:51.340203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e4d4d3a2-3888-434a-994c-dbd032285673 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:51.342788 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e4d4d3a2-3888-434a-994c-dbd032285673 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:51.343222 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e4d4d3a2-3888-434a-994c-dbd032285673 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:51.420430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8d0ff800-3169-4b6e-a076-d6d84950f4ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:51.421421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8d0ff800-3169-4b6e-a076-d6d84950f4ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:51.429162 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8d0ff800-3169-4b6e-a076-d6d84950f4ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:51.429836 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8d0ff800-3169-4b6e-a076-d6d84950f4ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:51.430977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8d0ff800-3169-4b6e-a076-d6d84950f4ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:51.431538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8d0ff800-3169-4b6e-a076-d6d84950f4ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:51.454480 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e4d4d3a2-3888-434a-994c-dbd032285673 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.128323 Aug 04 14:06:51.456391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 665/1361] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:51 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:51.548952 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8d0ff800-3169-4b6e-a076-d6d84950f4ea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.133089 Aug 04 14:06:51.549643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 697/1362] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:51 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:52.469848 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c0df291f-221a-4be6-be07-617a7d0c5f9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:52.470820 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c0df291f-221a-4be6-be07-617a7d0c5f9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:52.478471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c0df291f-221a-4be6-be07-617a7d0c5f9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:52.478916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c0df291f-221a-4be6-be07-617a7d0c5f9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:52.479693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c0df291f-221a-4be6-be07-617a7d0c5f9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:52.480117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c0df291f-221a-4be6-be07-617a7d0c5f9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:52.561413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2f06809d-0f7e-4a88-a2e1-2b4fd5cd0e1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:52.562447 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2f06809d-0f7e-4a88-a2e1-2b4fd5cd0e1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:52.569890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2f06809d-0f7e-4a88-a2e1-2b4fd5cd0e1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:52.570342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2f06809d-0f7e-4a88-a2e1-2b4fd5cd0e1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:52.571117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2f06809d-0f7e-4a88-a2e1-2b4fd5cd0e1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:52.571554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2f06809d-0f7e-4a88-a2e1-2b4fd5cd0e1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:52.621008 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c0df291f-221a-4be6-be07-617a7d0c5f9c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.155705 Aug 04 14:06:52.621577 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 666/1363] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:52 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:52.687337 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2f06809d-0f7e-4a88-a2e1-2b4fd5cd0e1f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.129816 Aug 04 14:06:52.688195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 698/1364] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:52 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:53.634487 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8e4d38cd-758d-44a7-8679-f9efd8ebeb79 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:53.635470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8e4d38cd-758d-44a7-8679-f9efd8ebeb79 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:53.642691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e4d38cd-758d-44a7-8679-f9efd8ebeb79 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:53.643740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e4d38cd-758d-44a7-8679-f9efd8ebeb79 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:53.644589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e4d38cd-758d-44a7-8679-f9efd8ebeb79 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:53.645022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8e4d38cd-758d-44a7-8679-f9efd8ebeb79 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:53.700341 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e1481efb-f58b-4909-8b9f-957501efdbd2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:53.701329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e1481efb-f58b-4909-8b9f-957501efdbd2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:53.708251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1481efb-f58b-4909-8b9f-957501efdbd2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:53.708701 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1481efb-f58b-4909-8b9f-957501efdbd2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:53.709468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1481efb-f58b-4909-8b9f-957501efdbd2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:53.709898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1481efb-f58b-4909-8b9f-957501efdbd2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:53.733177 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8e4d38cd-758d-44a7-8679-f9efd8ebeb79 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.103398 Aug 04 14:06:53.734165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 667/1365] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:53 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:53.812128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e1481efb-f58b-4909-8b9f-957501efdbd2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.115892 Aug 04 14:06:53.812821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 699/1366] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:53 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:54.747194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4caade47-7460-47d6-ac76-7a734ef4359a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:54.748198 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4caade47-7460-47d6-ac76-7a734ef4359a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:54.755369 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4caade47-7460-47d6-ac76-7a734ef4359a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:54.755809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4caade47-7460-47d6-ac76-7a734ef4359a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:54.756657 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4caade47-7460-47d6-ac76-7a734ef4359a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:54.757111 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4caade47-7460-47d6-ac76-7a734ef4359a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:54.824910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6ad97a81-b23a-4276-b519-f4552b220de3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:54.825885 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6ad97a81-b23a-4276-b519-f4552b220de3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:54.832865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ad97a81-b23a-4276-b519-f4552b220de3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:54.833299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ad97a81-b23a-4276-b519-f4552b220de3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:54.834061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ad97a81-b23a-4276-b519-f4552b220de3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:54.834484 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ad97a81-b23a-4276-b519-f4552b220de3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:54.884558 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4caade47-7460-47d6-ac76-7a734ef4359a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.141142 Aug 04 14:06:54.885247 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 668/1367] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:54 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:54.945936 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6ad97a81-b23a-4276-b519-f4552b220de3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.125064 Aug 04 14:06:54.946503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 700/1368] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:54 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:55.896606 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-67fe244f-5ab5-4cb9-ae71-01fd1d04cb37 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:55.897579 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-67fe244f-5ab5-4cb9-ae71-01fd1d04cb37 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:55.903921 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67fe244f-5ab5-4cb9-ae71-01fd1d04cb37 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:55.904395 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67fe244f-5ab5-4cb9-ae71-01fd1d04cb37 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:55.905150 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67fe244f-5ab5-4cb9-ae71-01fd1d04cb37 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:55.905575 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67fe244f-5ab5-4cb9-ae71-01fd1d04cb37 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:55.958477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f8a99e7d-df50-471b-a657-985cd0fe4ef2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:55.959467 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f8a99e7d-df50-471b-a657-985cd0fe4ef2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:55.966046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f8a99e7d-df50-471b-a657-985cd0fe4ef2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:55.966495 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f8a99e7d-df50-471b-a657-985cd0fe4ef2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:55.967270 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f8a99e7d-df50-471b-a657-985cd0fe4ef2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:55.967698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f8a99e7d-df50-471b-a657-985cd0fe4ef2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:55.998032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-67fe244f-5ab5-4cb9-ae71-01fd1d04cb37 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.105307 Aug 04 14:06:55.998696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 669/1369] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:55 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:56.094361 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f8a99e7d-df50-471b-a657-985cd0fe4ef2 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.139863 Aug 04 14:06:56.095208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 701/1370] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:55 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:57.014193 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-41b2b84d-816c-4d51-b646-5a1386049885 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:57.015193 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-41b2b84d-816c-4d51-b646-5a1386049885 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:57.021942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-41b2b84d-816c-4d51-b646-5a1386049885 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:57.022391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-41b2b84d-816c-4d51-b646-5a1386049885 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:57.023153 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-41b2b84d-816c-4d51-b646-5a1386049885 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:57.023586 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-41b2b84d-816c-4d51-b646-5a1386049885 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:57.126854 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-41b2b84d-816c-4d51-b646-5a1386049885 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.119068 Aug 04 14:06:57.127665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 670/1371] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:57 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:57.191113 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f40d5053-33ed-4b82-83b4-ed3d27467944 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:57.192089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f40d5053-33ed-4b82-83b4-ed3d27467944 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:57.198113 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f40d5053-33ed-4b82-83b4-ed3d27467944 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:57.198823 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f40d5053-33ed-4b82-83b4-ed3d27467944 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:57.199579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f40d5053-33ed-4b82-83b4-ed3d27467944 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:57.200003 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f40d5053-33ed-4b82-83b4-ed3d27467944 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:57.301732 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f40d5053-33ed-4b82-83b4-ed3d27467944 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.198663 Aug 04 14:06:57.302352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 702/1372] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:57 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:06:58.140087 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7bed48f7-baf3-445a-b966-bb9545eba354 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:58.141089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7bed48f7-baf3-445a-b966-bb9545eba354 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:58.148166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7bed48f7-baf3-445a-b966-bb9545eba354 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:58.148640 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7bed48f7-baf3-445a-b966-bb9545eba354 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:58.149389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7bed48f7-baf3-445a-b966-bb9545eba354 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:58.149815 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7bed48f7-baf3-445a-b966-bb9545eba354 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:58.243287 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7bed48f7-baf3-445a-b966-bb9545eba354 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.107084 Aug 04 14:06:58.244264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 671/1373] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:58 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:58.313688 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1c13f46c-5ac2-42d5-a2c6-20433b06acab tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:58.314661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1c13f46c-5ac2-42d5-a2c6-20433b06acab tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:58.321415 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c13f46c-5ac2-42d5-a2c6-20433b06acab tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:58.321846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c13f46c-5ac2-42d5-a2c6-20433b06acab tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:58.322636 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c13f46c-5ac2-42d5-a2c6-20433b06acab tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:58.323061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1c13f46c-5ac2-42d5-a2c6-20433b06acab tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:58.443776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1c13f46c-5ac2-42d5-a2c6-20433b06acab tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.133910 Aug 04 14:06:58.444640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 703/1374] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:58 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:06:59.255434 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c0fe3dbf-b869-4820-9940-a05857d4ec0c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:59.256446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c0fe3dbf-b869-4820-9940-a05857d4ec0c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:59.262883 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c0fe3dbf-b869-4820-9940-a05857d4ec0c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:59.263359 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c0fe3dbf-b869-4820-9940-a05857d4ec0c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:59.264125 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c0fe3dbf-b869-4820-9940-a05857d4ec0c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:59.264583 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c0fe3dbf-b869-4820-9940-a05857d4ec0c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:59.354882 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c0fe3dbf-b869-4820-9940-a05857d4ec0c tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.103328 Aug 04 14:06:59.355537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 672/1375] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:06:59 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:06:59.456933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d00e6561-d654-4bb6-b6c0-4d468244245d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:59.457943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d00e6561-d654-4bb6-b6c0-4d468244245d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:06:59.464828 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d00e6561-d654-4bb6-b6c0-4d468244245d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:59.465281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d00e6561-d654-4bb6-b6c0-4d468244245d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:59.466064 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d00e6561-d654-4bb6-b6c0-4d468244245d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:06:59.466502 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d00e6561-d654-4bb6-b6c0-4d468244245d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:06:59.572515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d00e6561-d654-4bb6-b6c0-4d468244245d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28692 microversion: 2.20 time: 0.119659 Aug 04 14:06:59.573070 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 704/1376] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:06:59 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28692 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:00.367894 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4232a790-19ea-4e37-b6cc-6b22a704c260 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:00.369048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4232a790-19ea-4e37-b6cc-6b22a704c260 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:00.375349 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4232a790-19ea-4e37-b6cc-6b22a704c260 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:00.375789 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4232a790-19ea-4e37-b6cc-6b22a704c260 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:00.376613 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4232a790-19ea-4e37-b6cc-6b22a704c260 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:00.377040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4232a790-19ea-4e37-b6cc-6b22a704c260 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:00.469531 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4232a790-19ea-4e37-b6cc-6b22a704c260 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.106254 Aug 04 14:07:00.470183 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 673/1377] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:00 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:00.587395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2e394695-d70f-4c9a-aed7-b81b81c588b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:00.588431 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2e394695-d70f-4c9a-aed7-b81b81c588b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:00.595136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e394695-d70f-4c9a-aed7-b81b81c588b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:00.595584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e394695-d70f-4c9a-aed7-b81b81c588b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:00.597081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e394695-d70f-4c9a-aed7-b81b81c588b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:00.597516 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e394695-d70f-4c9a-aed7-b81b81c588b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:00.711285 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2e394695-d70f-4c9a-aed7-b81b81c588b1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 28879 microversion: 2.20 time: 0.128794 Aug 04 14:07:00.712243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 705/1378] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:00 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 28879 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:07:01.482800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f9824815-8c76-4b18-9b94-a9f313f485a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:01.483815 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f9824815-8c76-4b18-9b94-a9f313f485a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:01.491388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f9824815-8c76-4b18-9b94-a9f313f485a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:01.491850 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f9824815-8c76-4b18-9b94-a9f313f485a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:01.492654 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f9824815-8c76-4b18-9b94-a9f313f485a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:01.493085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f9824815-8c76-4b18-9b94-a9f313f485a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:01.599890 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f9824815-8c76-4b18-9b94-a9f313f485a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.121079 Aug 04 14:07:01.602230 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 674/1379] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:01 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:01.724140 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-79656778-7e0e-4786-9578-44d1c2799c40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:01.725207 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-79656778-7e0e-4786-9578-44d1c2799c40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:01.732388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-79656778-7e0e-4786-9578-44d1c2799c40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:01.732846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-79656778-7e0e-4786-9578-44d1c2799c40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:01.733636 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-79656778-7e0e-4786-9578-44d1c2799c40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:01.734074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-79656778-7e0e-4786-9578-44d1c2799c40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:01.853597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-79656778-7e0e-4786-9578-44d1c2799c40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 30692 microversion: 2.20 time: 0.132957 Aug 04 14:07:01.854766 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 706/1380] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:01 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 30692 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:02.611779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5ec45c4e-7c05-4432-b0e2-70ebf158f1a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:02.612946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5ec45c4e-7c05-4432-b0e2-70ebf158f1a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:02.620005 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ec45c4e-7c05-4432-b0e2-70ebf158f1a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:02.620409 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ec45c4e-7c05-4432-b0e2-70ebf158f1a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:02.621223 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ec45c4e-7c05-4432-b0e2-70ebf158f1a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:02.621657 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5ec45c4e-7c05-4432-b0e2-70ebf158f1a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:02.730580 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5ec45c4e-7c05-4432-b0e2-70ebf158f1a1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.122816 Aug 04 14:07:02.731250 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 675/1381] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:02 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:02.866847 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1f945bef-e8f7-4a76-9cb4-06fd12b9be7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:02.867959 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1f945bef-e8f7-4a76-9cb4-06fd12b9be7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:02.874596 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f945bef-e8f7-4a76-9cb4-06fd12b9be7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:02.874969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f945bef-e8f7-4a76-9cb4-06fd12b9be7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:02.875733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f945bef-e8f7-4a76-9cb4-06fd12b9be7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:02.876159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f945bef-e8f7-4a76-9cb4-06fd12b9be7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:02.995710 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1f945bef-e8f7-4a76-9cb4-06fd12b9be7f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 32325 microversion: 2.20 time: 0.133721 Aug 04 14:07:02.996638 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 707/1382] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:02 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 32325 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:03.743504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-40d7a9ed-844f-4ce7-aa96-a1df4f7917f1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:03.744546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-40d7a9ed-844f-4ce7-aa96-a1df4f7917f1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:03.751319 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-40d7a9ed-844f-4ce7-aa96-a1df4f7917f1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:03.751770 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-40d7a9ed-844f-4ce7-aa96-a1df4f7917f1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:03.753194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-40d7a9ed-844f-4ce7-aa96-a1df4f7917f1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:03.753632 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-40d7a9ed-844f-4ce7-aa96-a1df4f7917f1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:03.856040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-40d7a9ed-844f-4ce7-aa96-a1df4f7917f1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.116489 Aug 04 14:07:03.856722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 676/1383] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:03 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:04.008737 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c781c811-1308-4ab3-ab58-e31e20cf881a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:04.009450 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c781c811-1308-4ab3-ab58-e31e20cf881a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:04.016468 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c781c811-1308-4ab3-ab58-e31e20cf881a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:04.016928 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c781c811-1308-4ab3-ab58-e31e20cf881a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:04.017713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c781c811-1308-4ab3-ab58-e31e20cf881a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:04.018142 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c781c811-1308-4ab3-ab58-e31e20cf881a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:04.123758 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c781c811-1308-4ab3-ab58-e31e20cf881a tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 33304 microversion: 2.20 time: 0.119653 Aug 04 14:07:04.124435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 708/1384] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:04 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 33304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:04.868865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b32b6a4f-e1d8-4bfb-b3a4-6da62ee38756 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:04.869858 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b32b6a4f-e1d8-4bfb-b3a4-6da62ee38756 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:04.876329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b32b6a4f-e1d8-4bfb-b3a4-6da62ee38756 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:04.876803 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b32b6a4f-e1d8-4bfb-b3a4-6da62ee38756 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:04.877572 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b32b6a4f-e1d8-4bfb-b3a4-6da62ee38756 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:04.878184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b32b6a4f-e1d8-4bfb-b3a4-6da62ee38756 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:05.000023 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b32b6a4f-e1d8-4bfb-b3a4-6da62ee38756 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.135082 Aug 04 14:07:05.001001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 677/1385] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:04 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:05.137406 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-03932342-cfb1-4b5f-ad22-7a905ed22ae8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:05.138322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-03932342-cfb1-4b5f-ad22-7a905ed22ae8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:05.144896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03932342-cfb1-4b5f-ad22-7a905ed22ae8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:05.145351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03932342-cfb1-4b5f-ad22-7a905ed22ae8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:05.146133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03932342-cfb1-4b5f-ad22-7a905ed22ae8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:05.146668 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-03932342-cfb1-4b5f-ad22-7a905ed22ae8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:05.288596 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-03932342-cfb1-4b5f-ad22-7a905ed22ae8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 34006 microversion: 2.20 time: 0.155841 Aug 04 14:07:05.289221 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 709/1386] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:05 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 34006 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:06.014415 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-134eaa07-5c5b-407e-ba59-2a5ce5e0dede tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:06.015386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-134eaa07-5c5b-407e-ba59-2a5ce5e0dede tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:06.022256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-134eaa07-5c5b-407e-ba59-2a5ce5e0dede tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:06.022698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-134eaa07-5c5b-407e-ba59-2a5ce5e0dede tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:06.023465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-134eaa07-5c5b-407e-ba59-2a5ce5e0dede tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:06.023893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-134eaa07-5c5b-407e-ba59-2a5ce5e0dede tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:06.126630 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-134eaa07-5c5b-407e-ba59-2a5ce5e0dede tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.116008 Aug 04 14:07:06.127999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 678/1387] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:06 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:06.301065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e1a9d082-193b-4edc-8d64-bb77b1f94676 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:06.302074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e1a9d082-193b-4edc-8d64-bb77b1f94676 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:06.309168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1a9d082-193b-4edc-8d64-bb77b1f94676 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:06.309615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1a9d082-193b-4edc-8d64-bb77b1f94676 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:06.310414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1a9d082-193b-4edc-8d64-bb77b1f94676 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:06.310846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e1a9d082-193b-4edc-8d64-bb77b1f94676 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:06.423374 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e1a9d082-193b-4edc-8d64-bb77b1f94676 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 35014 microversion: 2.20 time: 0.127167 Aug 04 14:07:06.424443 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 710/1388] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:06 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 35014 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:07.140336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5b69fc8c-5055-461e-aa3d-116b2fec24f8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:07.141350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-5b69fc8c-5055-461e-aa3d-116b2fec24f8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:07.148642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b69fc8c-5055-461e-aa3d-116b2fec24f8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:07.149091 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b69fc8c-5055-461e-aa3d-116b2fec24f8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:07.149884 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b69fc8c-5055-461e-aa3d-116b2fec24f8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:07.150316 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-5b69fc8c-5055-461e-aa3d-116b2fec24f8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:07.255607 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5b69fc8c-5055-461e-aa3d-116b2fec24f8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.119703 Aug 04 14:07:07.256308 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 679/1389] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:07 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:07.437341 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d50d8b2e-6f55-468b-8fd9-f79fb00b3d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:07.438239 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d50d8b2e-6f55-468b-8fd9-f79fb00b3d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:07.445014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d50d8b2e-6f55-468b-8fd9-f79fb00b3d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:07.445460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d50d8b2e-6f55-468b-8fd9-f79fb00b3d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:07.446240 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d50d8b2e-6f55-468b-8fd9-f79fb00b3d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:07.446670 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d50d8b2e-6f55-468b-8fd9-f79fb00b3d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:07.553154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d50d8b2e-6f55-468b-8fd9-f79fb00b3d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 36083 microversion: 2.20 time: 0.119834 Aug 04 14:07:07.553807 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 711/1390] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:07 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 36083 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:08.268282 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bf5dcf60-1483-4c20-acb6-dc3edd83ce76 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:08.269325 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bf5dcf60-1483-4c20-acb6-dc3edd83ce76 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:08.280514 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bf5dcf60-1483-4c20-acb6-dc3edd83ce76 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:08.280966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bf5dcf60-1483-4c20-acb6-dc3edd83ce76 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:08.281764 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bf5dcf60-1483-4c20-acb6-dc3edd83ce76 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:08.282263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bf5dcf60-1483-4c20-acb6-dc3edd83ce76 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:08.374820 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bf5dcf60-1483-4c20-acb6-dc3edd83ce76 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.110590 Aug 04 14:07:08.375496 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 680/1391] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:08 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:08.567018 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6202b6d8-accb-48a6-8c3f-076e40609719 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:08.568064 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6202b6d8-accb-48a6-8c3f-076e40609719 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:08.575065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6202b6d8-accb-48a6-8c3f-076e40609719 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:08.575513 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6202b6d8-accb-48a6-8c3f-076e40609719 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:08.576335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6202b6d8-accb-48a6-8c3f-076e40609719 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:08.576768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6202b6d8-accb-48a6-8c3f-076e40609719 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:08.676902 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6202b6d8-accb-48a6-8c3f-076e40609719 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 37658 microversion: 2.20 time: 0.114849 Aug 04 14:07:08.677558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 712/1392] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:08 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 37658 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:07:09.387513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f1872296-e6fb-4133-9b1e-eeae09388036 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:09.388538 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f1872296-e6fb-4133-9b1e-eeae09388036 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:09.395856 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f1872296-e6fb-4133-9b1e-eeae09388036 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:09.396612 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f1872296-e6fb-4133-9b1e-eeae09388036 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:09.397400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f1872296-e6fb-4133-9b1e-eeae09388036 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:09.397831 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f1872296-e6fb-4133-9b1e-eeae09388036 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:09.507943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f1872296-e6fb-4133-9b1e-eeae09388036 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.124317 Aug 04 14:07:09.510191 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 681/1393] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:09 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:09.689083 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-75f0be05-f4ae-486c-af47-8942a0831cb1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:09.690659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-75f0be05-f4ae-486c-af47-8942a0831cb1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:09.697142 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75f0be05-f4ae-486c-af47-8942a0831cb1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:09.697579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75f0be05-f4ae-486c-af47-8942a0831cb1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:09.698350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75f0be05-f4ae-486c-af47-8942a0831cb1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:09.699034 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75f0be05-f4ae-486c-af47-8942a0831cb1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:09.801329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-75f0be05-f4ae-486c-af47-8942a0831cb1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 38243 microversion: 2.20 time: 0.116283 Aug 04 14:07:09.802253 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 713/1394] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:09 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 38243 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:10.523437 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b375f6cd-8f21-4088-ada1-bd0b70305fb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:10.524607 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b375f6cd-8f21-4088-ada1-bd0b70305fb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:10.531521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b375f6cd-8f21-4088-ada1-bd0b70305fb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:10.531964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b375f6cd-8f21-4088-ada1-bd0b70305fb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:10.532950 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b375f6cd-8f21-4088-ada1-bd0b70305fb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:10.534329 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b375f6cd-8f21-4088-ada1-bd0b70305fb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:10.640467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b375f6cd-8f21-4088-ada1-bd0b70305fb8 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.122142 Aug 04 14:07:10.641311 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 682/1395] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:10 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:10.814351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8d79af1d-5914-4a6e-a29f-d33ad5b0d95e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:10.815572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8d79af1d-5914-4a6e-a29f-d33ad5b0d95e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:10.821867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8d79af1d-5914-4a6e-a29f-d33ad5b0d95e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:10.822316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8d79af1d-5914-4a6e-a29f-d33ad5b0d95e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:10.823094 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8d79af1d-5914-4a6e-a29f-d33ad5b0d95e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:10.823526 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8d79af1d-5914-4a6e-a29f-d33ad5b0d95e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:10.945623 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8d79af1d-5914-4a6e-a29f-d33ad5b0d95e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 38243 microversion: 2.20 time: 0.135550 Aug 04 14:07:10.946324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 714/1396] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:10 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 38243 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:11.652918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7f9478b5-e1a5-4e72-8e3e-3e5f286f3bf1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:11.653817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7f9478b5-e1a5-4e72-8e3e-3e5f286f3bf1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:11.660628 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7f9478b5-e1a5-4e72-8e3e-3e5f286f3bf1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:11.661077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7f9478b5-e1a5-4e72-8e3e-3e5f286f3bf1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:11.661857 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7f9478b5-e1a5-4e72-8e3e-3e5f286f3bf1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:11.662283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7f9478b5-e1a5-4e72-8e3e-3e5f286f3bf1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:11.755205 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7f9478b5-e1a5-4e72-8e3e-3e5f286f3bf1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.106335 Aug 04 14:07:11.756117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 683/1397] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:11 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:11.958746 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-402724c2-f26b-4ffd-8250-e710e14db5cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:11.959735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-402724c2-f26b-4ffd-8250-e710e14db5cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:11.966414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-402724c2-f26b-4ffd-8250-e710e14db5cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:11.966863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-402724c2-f26b-4ffd-8250-e710e14db5cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:11.967629 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-402724c2-f26b-4ffd-8250-e710e14db5cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:11.968050 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-402724c2-f26b-4ffd-8250-e710e14db5cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:12.076782 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-402724c2-f26b-4ffd-8250-e710e14db5cd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 38243 microversion: 2.20 time: 0.122976 Aug 04 14:07:12.077440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 715/1398] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:11 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 38243 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:12.769031 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-962d0953-158d-4cf8-9ee9-647a7b5869a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:12.770054 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-962d0953-158d-4cf8-9ee9-647a7b5869a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:12.776931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-962d0953-158d-4cf8-9ee9-647a7b5869a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:12.777375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-962d0953-158d-4cf8-9ee9-647a7b5869a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:12.778142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-962d0953-158d-4cf8-9ee9-647a7b5869a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:12.778592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-962d0953-158d-4cf8-9ee9-647a7b5869a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:12.901894 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-962d0953-158d-4cf8-9ee9-647a7b5869a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.138119 Aug 04 14:07:12.902790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 684/1399] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:12 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:13.090815 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e3fefe71-85a1-42fa-9a94-1a38b555d385 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:13.091789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e3fefe71-85a1-42fa-9a94-1a38b555d385 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:13.098304 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e3fefe71-85a1-42fa-9a94-1a38b555d385 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:13.098748 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e3fefe71-85a1-42fa-9a94-1a38b555d385 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:13.099518 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e3fefe71-85a1-42fa-9a94-1a38b555d385 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:13.099949 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e3fefe71-85a1-42fa-9a94-1a38b555d385 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:13.189974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e3fefe71-85a1-42fa-9a94-1a38b555d385 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 38243 microversion: 2.20 time: 0.102622 Aug 04 14:07:13.190633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 716/1400] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:13 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 38243 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:13.914806 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a730cc45-4ba4-4557-9442-9439ca0206d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:13.915790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a730cc45-4ba4-4557-9442-9439ca0206d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:13.922287 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a730cc45-4ba4-4557-9442-9439ca0206d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:13.922733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a730cc45-4ba4-4557-9442-9439ca0206d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:13.923750 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a730cc45-4ba4-4557-9442-9439ca0206d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:13.924689 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a730cc45-4ba4-4557-9442-9439ca0206d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:14.012979 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a730cc45-4ba4-4557-9442-9439ca0206d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.102087 Aug 04 14:07:14.013760 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 685/1401] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:13 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:14.203050 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c5b3401c-8bfb-4d16-a84e-6f029a302041 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:14.204100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c5b3401c-8bfb-4d16-a84e-6f029a302041 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:14.211527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c5b3401c-8bfb-4d16-a84e-6f029a302041 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:14.211527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c5b3401c-8bfb-4d16-a84e-6f029a302041 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:14.211527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c5b3401c-8bfb-4d16-a84e-6f029a302041 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:14.213548 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c5b3401c-8bfb-4d16-a84e-6f029a302041 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:14.319762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c5b3401c-8bfb-4d16-a84e-6f029a302041 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 200 len: 38386 microversion: 2.20 time: 0.120320 Aug 04 14:07:14.320503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 717/1402] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:14 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 38386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:14.331629 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a0f1d6f1-0a54-46e3-8c4c-a9755d9b7d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:14.332209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a0f1d6f1-0a54-46e3-8c4c-a9755d9b7d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:14.338870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a0f1d6f1-0a54-46e3-8c4c-a9755d9b7d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:14.339318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a0f1d6f1-0a54-46e3-8c4c-a9755d9b7d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:14.340091 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a0f1d6f1-0a54-46e3-8c4c-a9755d9b7d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:14.340559 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a0f1d6f1-0a54-46e3-8c4c-a9755d9b7d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:14.365278 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a0f1d6f1-0a54-46e3-8c4c-a9755d9b7d23 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/ips" status: 200 len: 152 microversion: 2.20 time: 0.038241 Aug 04 14:07:14.365869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 686/1403] 10.222.0.43 () {60 vars in 1289 bytes} [Wed Aug 4 14:07:14 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:15.025492 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-62987bd4-d744-4c84-82ed-6740de07912b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:15.026483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-62987bd4-d744-4c84-82ed-6740de07912b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:15.032943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-62987bd4-d744-4c84-82ed-6740de07912b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:15.034014 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-62987bd4-d744-4c84-82ed-6740de07912b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:15.034792 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-62987bd4-d744-4c84-82ed-6740de07912b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:15.035226 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-62987bd4-d744-4c84-82ed-6740de07912b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:15.120305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-62987bd4-d744-4c84-82ed-6740de07912b tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.098697 Aug 04 14:07:15.120999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 718/1404] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:15 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:16.132407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-163aebcb-49a6-4824-b770-977c0612bc6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:16.133467 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-163aebcb-49a6-4824-b770-977c0612bc6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:16.140338 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-163aebcb-49a6-4824-b770-977c0612bc6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:16.140790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-163aebcb-49a6-4824-b770-977c0612bc6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:16.141562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-163aebcb-49a6-4824-b770-977c0612bc6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:16.141995 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-163aebcb-49a6-4824-b770-977c0612bc6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:16.232733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-163aebcb-49a6-4824-b770-977c0612bc6e tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.103837 Aug 04 14:07:16.233697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 687/1405] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:16 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:16.793147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bdd8d098-3cef-4d59-bede-41d7c19e4244 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:16.794133 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bdd8d098-3cef-4d59-bede-41d7c19e4244 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:16.805593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdd8d098-3cef-4d59-bede-41d7c19e4244 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:16.806381 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdd8d098-3cef-4d59-bede-41d7c19e4244 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:16.807758 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdd8d098-3cef-4d59-bede-41d7c19e4244 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:16.808588 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bdd8d098-3cef-4d59-bede-41d7c19e4244 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:16.832811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-bdd8d098-3cef-4d59-bede-41d7c19e4244 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lazy-loading 'flavor' on Instance uuid 71864169-d3ea-45e4-8e11-0a36283b817c {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:07:17.083089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bdd8d098-3cef-4d59-bede-41d7c19e4244 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 202 len: 0 microversion: 2.20 time: 0.294021 Aug 04 14:07:17.083706 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 719/1406] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:16 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:07:17.096191 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:17.096910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:17.103165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:17.103616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:17.104529 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:17.104952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:17.227733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:17.236760 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:17.238444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:17.239589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-883e0bd5-216c-425f-9484-134308686038 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.151376 Aug 04 14:07:17.240582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 688/1407] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:17 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:17.248169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3a78b1de-d1e3-4ed4-baec-325102eef848 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:17.248169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3a78b1de-d1e3-4ed4-baec-325102eef848 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:17.253592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a78b1de-d1e3-4ed4-baec-325102eef848 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:17.254064 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a78b1de-d1e3-4ed4-baec-325102eef848 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:17.254838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a78b1de-d1e3-4ed4-baec-325102eef848 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:17.255299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a78b1de-d1e3-4ed4-baec-325102eef848 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:17.374274 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3a78b1de-d1e3-4ed4-baec-325102eef848 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.132510 Aug 04 14:07:17.374927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 720/1408] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:17 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:18.258096 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.258691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:18.264880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:18.265314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:18.266073 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:18.266495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:18.386905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:18.387063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-66b57071-5826-402a-aa00-75b995a5ddbc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:18.388139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-66b57071-5826-402a-aa00-75b995a5ddbc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:18.395004 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:18.395237 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66b57071-5826-402a-aa00-75b995a5ddbc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:18.395457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66b57071-5826-402a-aa00-75b995a5ddbc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:18.396241 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66b57071-5826-402a-aa00-75b995a5ddbc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:18.396652 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:18.396784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-66b57071-5826-402a-aa00-75b995a5ddbc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:18.397876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7c3c8da3-2204-46f5-9bf9-caedfd126783 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.143573 Aug 04 14:07:18.398519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 689/1409] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:18 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:18.495444 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-66b57071-5826-402a-aa00-75b995a5ddbc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.112312 Aug 04 14:07:18.496483 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 721/1410] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:18 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:19.418520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:19.419120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:19.424914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:19.425348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:19.426105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:19.426525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:19.508164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-07895e9b-eddb-483b-b819-642daca618b1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:19.509236 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-07895e9b-eddb-483b-b819-642daca618b1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:19.515811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07895e9b-eddb-483b-b819-642daca618b1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:19.517520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07895e9b-eddb-483b-b819-642daca618b1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:19.518619 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07895e9b-eddb-483b-b819-642daca618b1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:19.519081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07895e9b-eddb-483b-b819-642daca618b1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:19.553310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:19.560872 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:19.562353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:19.563473 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c697ee1e-a3f8-4a7e-8a5f-b0ee50b2ed7e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.148650 Aug 04 14:07:19.564028 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 690/1411] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:19 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:19.623910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-07895e9b-eddb-483b-b819-642daca618b1 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.119543 Aug 04 14:07:19.624510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 722/1412] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:19 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:20.582091 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:20.582681 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:20.588968 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:20.589409 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:20.590162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:20.590610 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:20.637787 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fed64bde-d7d5-46d2-9727-7e8ca56f7291 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:20.638689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fed64bde-d7d5-46d2-9727-7e8ca56f7291 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:20.644881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fed64bde-d7d5-46d2-9727-7e8ca56f7291 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:20.646504 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fed64bde-d7d5-46d2-9727-7e8ca56f7291 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:20.646934 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fed64bde-d7d5-46d2-9727-7e8ca56f7291 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:20.647374 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fed64bde-d7d5-46d2-9727-7e8ca56f7291 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:20.721693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.729413 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.730894 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.732027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3469d4f6-f697-4d96-bfec-9367619ee65c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.154274 Aug 04 14:07:20.732607 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 691/1413] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:20 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:20.750242 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fed64bde-d7d5-46d2-9727-7e8ca56f7291 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.116957 Aug 04 14:07:20.750896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 723/1414] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:20 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:21.122185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b13205d9-0f45-4a2e-9110-c77cd82c6ae0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1409387756"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:21.122710 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b13205d9-0f45-4a2e-9110-c77cd82c6ae0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:21.129517 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b13205d9-0f45-4a2e-9110-c77cd82c6ae0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:21.129960 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b13205d9-0f45-4a2e-9110-c77cd82c6ae0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:21.130716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b13205d9-0f45-4a2e-9110-c77cd82c6ae0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:21.131139 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b13205d9-0f45-4a2e-9110-c77cd82c6ae0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:21.248994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.network.security_group_api [None req-b13205d9-0f45-4a2e-9110-c77cd82c6ae0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Removing security group 54754f91-d567-449f-a15a-a11095ae7a26 from port beceb660-6af5-4957-92be-e4d30ef7ad50 Aug 04 14:07:21.593653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b13205d9-0f45-4a2e-9110-c77cd82c6ae0 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "POST /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/action" status: 202 len: 0 microversion: 2.1 time: 0.475134 Aug 04 14:07:21.595835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 692/1415] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:21 2021] POST /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:21.604352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-fb615bf1-c5ec-4504-853c-90eb30642578 req-2fd3bf10-dd1e-4432-a17b-26efe7492754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246a1a60-bd1b-41f4-b264-35142d684f8d", "tag": "beceb660-6af5-4957-92be-e4d30ef7ad50"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:21.605845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:07:21.605845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:07:21.621043 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-fb615bf1-c5ec-4504-853c-90eb30642578 req-2fd3bf10-dd1e-4432-a17b-26efe7492754 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:21.621489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-fb615bf1-c5ec-4504-853c-90eb30642578 req-2fd3bf10-dd1e-4432-a17b-26efe7492754 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:21.647378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-fb615bf1-c5ec-4504-853c-90eb30642578 req-2fd3bf10-dd1e-4432-a17b-26efe7492754 service nova] Creating event network-changed:beceb660-6af5-4957-92be-e4d30ef7ad50 for instance 246a1a60-bd1b-41f4-b264-35142d684f8d on hv-cinder-79264 Aug 04 14:07:21.652231 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-fb615bf1-c5ec-4504-853c-90eb30642578 req-2fd3bf10-dd1e-4432-a17b-26efe7492754 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051757 Aug 04 14:07:21.652889 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 724/1416] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:07:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:21.749857 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.750473 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:21.763091 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-acaf7338-0c4e-4f6d-8816-207131ffe628 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:21.764021 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-acaf7338-0c4e-4f6d-8816-207131ffe628 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:21.770948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:21.771403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:21.772238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:21.774522 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acaf7338-0c4e-4f6d-8816-207131ffe628 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:21.774979 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acaf7338-0c4e-4f6d-8816-207131ffe628 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:21.775769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acaf7338-0c4e-4f6d-8816-207131ffe628 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:21.776201 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-acaf7338-0c4e-4f6d-8816-207131ffe628 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:21.776745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:21.909639 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-acaf7338-0c4e-4f6d-8816-207131ffe628 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.148975 Aug 04 14:07:21.911287 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 725/1417] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:21 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:22.048454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:22.060665 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:22.062676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:22.064147 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4900a9c2-0295-4eac-80a2-b8ccd5992ddd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.317940 Aug 04 14:07:22.065792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 693/1418] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:21 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:22.922300 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-abd8fa6e-f5db-4a2d-9595-7cd9675b12a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:22.923303 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-abd8fa6e-f5db-4a2d-9595-7cd9675b12a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:22.930135 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abd8fa6e-f5db-4a2d-9595-7cd9675b12a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:22.930586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abd8fa6e-f5db-4a2d-9595-7cd9675b12a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:22.931369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abd8fa6e-f5db-4a2d-9595-7cd9675b12a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:22.931803 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-abd8fa6e-f5db-4a2d-9595-7cd9675b12a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:23.016506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-abd8fa6e-f5db-4a2d-9595-7cd9675b12a2 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.098077 Aug 04 14:07:23.017174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 726/1419] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:22 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:23.047608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-63b5032a-39c0-461f-8c42-9cbe939909db tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.048155 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-63b5032a-39c0-461f-8c42-9cbe939909db tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:23.054546 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-63b5032a-39c0-461f-8c42-9cbe939909db tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:23.054999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-63b5032a-39c0-461f-8c42-9cbe939909db tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:23.055777 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-63b5032a-39c0-461f-8c42-9cbe939909db tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:23.056208 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-63b5032a-39c0-461f-8c42-9cbe939909db tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:23.083563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.084757 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:23.093124 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:23.093607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:23.094499 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:23.095150 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:23.145592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-63b5032a-39c0-461f-8c42-9cbe939909db tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lazy-loading 'services' on Instance uuid 246a1a60-bd1b-41f4-b264-35142d684f8d {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:07:23.223353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-63b5032a-39c0-461f-8c42-9cbe939909db tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "DELETE /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments/ceb50c90-c004-4175-bc28-896a7ed2ac30" status: 202 len: 0 microversion: 2.1 time: 0.179294 Aug 04 14:07:23.226013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 694/1420] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:07:23 2021] DELETE /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments/ceb50c90-c004-4175-bc28-896a7ed2ac30 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:23.232964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-67863dae-21b4-4611-adc1-b3c6e2cd9d78 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.234322 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-67863dae-21b4-4611-adc1-b3c6e2cd9d78 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:23.244321 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:23.250004 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67863dae-21b4-4611-adc1-b3c6e2cd9d78 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:23.250535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67863dae-21b4-4611-adc1-b3c6e2cd9d78 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:23.251554 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67863dae-21b4-4611-adc1-b3c6e2cd9d78 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:23.252724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67863dae-21b4-4611-adc1-b3c6e2cd9d78 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:23.254316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:23.255880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:23.257293 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-75280ce5-09ba-4f9f-8956-8928e45aaed1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.178170 Aug 04 14:07:23.257969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 727/1421] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:23 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:07:23.284796 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-67863dae-21b4-4611-adc1-b3c6e2cd9d78 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056120 Aug 04 14:07:23.288771 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 695/1422] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Aug 4 14:07:23 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:07:23.667834 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-ed61eddd-3092-45d3-92fd-67144512e5e5 req-56c5b561-8d28-4199-b477-9d1ae014b1ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246a1a60-bd1b-41f4-b264-35142d684f8d", "tag": "beceb660-6af5-4957-92be-e4d30ef7ad50"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:23.669431 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:07:23.669431 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:07:23.677072 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-ed61eddd-3092-45d3-92fd-67144512e5e5 req-56c5b561-8d28-4199-b477-9d1ae014b1ff service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:23.677513 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-ed61eddd-3092-45d3-92fd-67144512e5e5 req-56c5b561-8d28-4199-b477-9d1ae014b1ff service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:23.688738 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-ed61eddd-3092-45d3-92fd-67144512e5e5 req-56c5b561-8d28-4199-b477-9d1ae014b1ff service nova] Creating event network-changed:beceb660-6af5-4957-92be-e4d30ef7ad50 for instance 246a1a60-bd1b-41f4-b264-35142d684f8d on hv-cinder-79264 Aug 04 14:07:23.694451 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-ed61eddd-3092-45d3-92fd-67144512e5e5 req-56c5b561-8d28-4199-b477-9d1ae014b1ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030025 Aug 04 14:07:23.695054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 728/1423] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:07:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:24.028156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b3c8fdec-60eb-42ab-8641-9b169bae36c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:24.029131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b3c8fdec-60eb-42ab-8641-9b169bae36c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:24.035740 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3c8fdec-60eb-42ab-8641-9b169bae36c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:24.036539 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3c8fdec-60eb-42ab-8641-9b169bae36c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:24.037354 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3c8fdec-60eb-42ab-8641-9b169bae36c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:24.037886 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3c8fdec-60eb-42ab-8641-9b169bae36c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:24.143245 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b3c8fdec-60eb-42ab-8641-9b169bae36c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.117870 Aug 04 14:07:24.143909 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 696/1424] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:24 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:24.277301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:24.277994 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:24.284040 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:24.284500 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:24.285310 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:24.285834 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:24.296696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-093a22af-2cc4-4940-a075-f9729c465f12 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:24.297686 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-093a22af-2cc4-4940-a075-f9729c465f12 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:24.305162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-093a22af-2cc4-4940-a075-f9729c465f12 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:24.305751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-093a22af-2cc4-4940-a075-f9729c465f12 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:24.306847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-093a22af-2cc4-4940-a075-f9729c465f12 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:24.307343 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-093a22af-2cc4-4940-a075-f9729c465f12 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:24.342011 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-093a22af-2cc4-4940-a075-f9729c465f12 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049389 Aug 04 14:07:24.342533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 697/1425] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Aug 4 14:07:24 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 14:07:24.353728 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:24.354283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:24.360244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:24.360709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:24.361637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:24.362145 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:24.424659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:24.432731 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:24.434215 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:24.435377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-efbf595f-564a-48df-b95d-0d81dfaf7e2c tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.162898 Aug 04 14:07:24.435996 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 729/1426] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:24 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:24.443828 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] HTTP exception thrown: Instance 246a1a60-bd1b-41f4-b264-35142d684f8d is not attached to volume ceb50c90-c004-4175-bc28-896a7ed2ac30 Aug 04 14:07:24.444489 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Returning 404 to user: Instance 246a1a60-bd1b-41f4-b264-35142d684f8d is not attached to volume ceb50c90-c004-4175-bc28-896a7ed2ac30 {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:07:24.445347 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4565d667-98ab-4452-9954-e9cd2ec2777d tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "DELETE /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments/ceb50c90-c004-4175-bc28-896a7ed2ac30" status: 404 len: 154 microversion: 2.1 time: 0.095679 Aug 04 14:07:24.446068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 698/1427] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:07:24 2021] DELETE /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d/os-volume_attachments/ceb50c90-c004-4175-bc28-896a7ed2ac30 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:25.154886 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8cf950c1-2c3a-4717-bbc3-d3705df1db1a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:25.155821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8cf950c1-2c3a-4717-bbc3-d3705df1db1a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:25.162317 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8cf950c1-2c3a-4717-bbc3-d3705df1db1a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:25.162764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8cf950c1-2c3a-4717-bbc3-d3705df1db1a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:25.163530 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8cf950c1-2c3a-4717-bbc3-d3705df1db1a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:25.163961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8cf950c1-2c3a-4717-bbc3-d3705df1db1a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:25.256916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8cf950c1-2c3a-4717-bbc3-d3705df1db1a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.105460 Aug 04 14:07:25.257557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 730/1428] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:25 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:25.454295 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:25.455483 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:25.461824 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:25.462259 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:25.463021 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:25.463444 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:25.589943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-677743e0-d9f4-4e53-93df-7503292a0849 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:25.590417 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:25.590564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-677743e0-d9f4-4e53-93df-7503292a0849 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:25.597720 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-677743e0-d9f4-4e53-93df-7503292a0849 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:25.598169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-677743e0-d9f4-4e53-93df-7503292a0849 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:25.598707 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:25.598948 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-677743e0-d9f4-4e53-93df-7503292a0849 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:25.599384 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-677743e0-d9f4-4e53-93df-7503292a0849 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:25.600193 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:25.601360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c763c7fc-8414-4d77-9193-22fe0bd48edb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.150893 Aug 04 14:07:25.601916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 699/1429] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:25 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:25.623812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-677743e0-d9f4-4e53-93df-7503292a0849 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Going to try to terminate instance {{(pid=107822) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:07:25.697878 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-677743e0-d9f4-4e53-93df-7503292a0849 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "DELETE /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 204 len: 0 microversion: 2.1 time: 0.111601 Aug 04 14:07:25.698569 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 731/1430] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:07:25 2021] DELETE /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:07:25.707482 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9705440a-e6aa-4b5c-836f-782db9bbadef tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:25.708094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9705440a-e6aa-4b5c-836f-782db9bbadef tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:25.713899 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9705440a-e6aa-4b5c-836f-782db9bbadef tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:25.714344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9705440a-e6aa-4b5c-836f-782db9bbadef tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:25.715105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9705440a-e6aa-4b5c-836f-782db9bbadef tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:25.715536 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9705440a-e6aa-4b5c-836f-782db9bbadef tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:25.839405 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9705440a-e6aa-4b5c-836f-782db9bbadef tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:25.846931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9705440a-e6aa-4b5c-836f-782db9bbadef tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1555 microversion: 2.1 time: 0.143797 Aug 04 14:07:25.847492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 700/1431] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:07:25 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1555 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:26.269486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-93f47744-c7c2-4295-95c6-62b0c23a92bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:26.270477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-93f47744-c7c2-4295-95c6-62b0c23a92bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:26.276329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-93f47744-c7c2-4295-95c6-62b0c23a92bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:26.276776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-93f47744-c7c2-4295-95c6-62b0c23a92bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:26.277537 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-93f47744-c7c2-4295-95c6-62b0c23a92bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:26.277985 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-93f47744-c7c2-4295-95c6-62b0c23a92bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:26.376585 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-93f47744-c7c2-4295-95c6-62b0c23a92bc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.111205 Aug 04 14:07:26.377856 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 732/1432] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:26 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:26.619039 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:26.619571 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:26.625416 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:26.625863 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:26.626616 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:26.627097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:26.759904 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:26.768509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:26.770004 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:26.771298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9a303732-21f2-43a6-9c3f-0e4b78b22653 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.156112 Aug 04 14:07:26.771859 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 701/1433] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:26 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:26.864911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-52d08e8a-5e7f-4a76-887a-11e43a7eee57 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:26.865592 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-52d08e8a-5e7f-4a76-887a-11e43a7eee57 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:26.872401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-52d08e8a-5e7f-4a76-887a-11e43a7eee57 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:26.872891 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-52d08e8a-5e7f-4a76-887a-11e43a7eee57 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:26.873657 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-52d08e8a-5e7f-4a76-887a-11e43a7eee57 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:26.874076 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-52d08e8a-5e7f-4a76-887a-11e43a7eee57 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:27.002388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-52d08e8a-5e7f-4a76-887a-11e43a7eee57 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:27.009672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-52d08e8a-5e7f-4a76-887a-11e43a7eee57 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1555 microversion: 2.1 time: 0.149175 Aug 04 14:07:27.010234 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 733/1434] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:07:26 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:27.388172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-10fb05fa-f4de-4082-9afe-340d9ad72fda tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:27.389139 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-10fb05fa-f4de-4082-9afe-340d9ad72fda tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:27.396036 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-10fb05fa-f4de-4082-9afe-340d9ad72fda tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:27.396661 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-10fb05fa-f4de-4082-9afe-340d9ad72fda tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:27.397424 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-10fb05fa-f4de-4082-9afe-340d9ad72fda tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:27.397855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-10fb05fa-f4de-4082-9afe-340d9ad72fda tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:27.484976 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-10fb05fa-f4de-4082-9afe-340d9ad72fda tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 28728 microversion: 2.1 time: 0.100420 Aug 04 14:07:27.485623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 702/1435] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:27 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 28728 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:27.789457 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:27.790058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:27.795870 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:27.796357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:27.797132 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:27.797568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:27.917736 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:27.927338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:27.928917 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:27.930070 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-47417e32-e2e2-4f9a-8750-f97e022a8709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.144403 Aug 04 14:07:27.930628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 734/1436] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:27 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:07:28.027608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-604ef729-3f6d-449b-b93c-68bd5d548270 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:28.028412 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-604ef729-3f6d-449b-b93c-68bd5d548270 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:28.035490 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-604ef729-3f6d-449b-b93c-68bd5d548270 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:28.035937 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-604ef729-3f6d-449b-b93c-68bd5d548270 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:28.036838 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-604ef729-3f6d-449b-b93c-68bd5d548270 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:28.037271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-604ef729-3f6d-449b-b93c-68bd5d548270 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:28.161247 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-604ef729-3f6d-449b-b93c-68bd5d548270 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:28.168666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-604ef729-3f6d-449b-b93c-68bd5d548270 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1555 microversion: 2.1 time: 0.145118 Aug 04 14:07:28.169230 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 703/1437] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:07:28 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:28.497740 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d83a5569-495b-45d3-bec4-405e7d7c9006 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:28.498644 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d83a5569-495b-45d3-bec4-405e7d7c9006 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:28.505311 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d83a5569-495b-45d3-bec4-405e7d7c9006 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:28.505757 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d83a5569-495b-45d3-bec4-405e7d7c9006 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:28.506535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d83a5569-495b-45d3-bec4-405e7d7c9006 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:28.506977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d83a5569-495b-45d3-bec4-405e7d7c9006 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:28.613774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d83a5569-495b-45d3-bec4-405e7d7c9006 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 30040 microversion: 2.1 time: 0.119875 Aug 04 14:07:28.614432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 735/1438] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:28 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 30040 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:28.837627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-c74046c7-3844-4c08-8a6e-4b820c6ac290 req-7057d1e3-54a1-4f68-af33-fd177ab42891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246a1a60-bd1b-41f4-b264-35142d684f8d", "name": "network-vif-deleted", "tag": "beceb660-6af5-4957-92be-e4d30ef7ad50"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:28.839464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:07:28.839464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:07:28.847060 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-c74046c7-3844-4c08-8a6e-4b820c6ac290 req-7057d1e3-54a1-4f68-af33-fd177ab42891 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:28.847497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-c74046c7-3844-4c08-8a6e-4b820c6ac290 req-7057d1e3-54a1-4f68-af33-fd177ab42891 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:28.858185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-c74046c7-3844-4c08-8a6e-4b820c6ac290 req-7057d1e3-54a1-4f68-af33-fd177ab42891 service nova] Creating event network-vif-deleted:beceb660-6af5-4957-92be-e4d30ef7ad50 for instance 246a1a60-bd1b-41f4-b264-35142d684f8d on hv-cinder-79264 Aug 04 14:07:28.863285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-c74046c7-3844-4c08-8a6e-4b820c6ac290 req-7057d1e3-54a1-4f68-af33-fd177ab42891 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029358 Aug 04 14:07:28.864080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 704/1439] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:07:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:28.950701 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:28.951393 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:28.958299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:28.958739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:28.959647 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:28.960074 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:29.091149 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:29.099562 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:29.101221 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:29.102547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-801fa69e-5da5-4964-a4bc-01adf082c7ee tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.156060 Aug 04 14:07:29.103110 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 736/1440] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:28 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:29.187334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:29.188151 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:29.194647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:29.195093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:29.195870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:29.196333 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:29.230103 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:29.230280 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:29.230733 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lazy-loading 'fault' on Instance uuid 246a1a60-bd1b-41f4-b264-35142d684f8d {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:07:29.272047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd30a4a2aaf541be9793ab2964b1662c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd8064518c746d397f5d10d94300938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:29.279387 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-05596aea-0a21-4cf2-a7de-4ef47efdb040 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 200 len: 1348 microversion: 2.1 time: 0.096568 Aug 04 14:07:29.279966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 705/1441] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:07:29 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:29.624858 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7cefefdd-7b0d-4198-b8dc-e1dea9a8b3ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:29.625651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7cefefdd-7b0d-4198-b8dc-e1dea9a8b3ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:29.632171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7cefefdd-7b0d-4198-b8dc-e1dea9a8b3ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:29.632653 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7cefefdd-7b0d-4198-b8dc-e1dea9a8b3ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:29.633417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7cefefdd-7b0d-4198-b8dc-e1dea9a8b3ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:29.633846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7cefefdd-7b0d-4198-b8dc-e1dea9a8b3ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:29.733970 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7cefefdd-7b0d-4198-b8dc-e1dea9a8b3ef tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 31830 microversion: 2.1 time: 0.112742 Aug 04 14:07:29.734677 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 737/1442] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:29 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 31830 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:30.119889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:30.120504 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:30.129206 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:30.129751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:30.130572 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:30.131010 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:30.255441 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:30.263057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:30.264569 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:30.265688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c5dcc82a-a34c-4240-8588-b9dca33516a6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.149507 Aug 04 14:07:30.266239 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 706/1443] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:30 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:30.296861 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:30.297554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] [instance: 246a1a60-bd1b-41f4-b264-35142d684f8d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:30.304554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:30.305000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:30.305795 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:30.306227 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:30.319324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] HTTP exception thrown: Instance 246a1a60-bd1b-41f4-b264-35142d684f8d could not be found. Aug 04 14:07:30.319908 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Returning 404 to user: Instance 246a1a60-bd1b-41f4-b264-35142d684f8d could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:07:30.320760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4e0fb86b-f3e3-4db3-88cd-4ff81b19eb24 tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d" status: 404 len: 111 microversion: 2.1 time: 0.028251 Aug 04 14:07:30.321279 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 738/1444] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:07:30 2021] GET /compute/v2.1/servers/246a1a60-bd1b-41f4-b264-35142d684f8d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:30.329347 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-05ddda17-a5f4-4544-8410-9eb87064955a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] Calling method '.version_select at 0x7efe7c3c3280>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:30.348306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-05ddda17-a5f4-4544-8410-9eb87064955a tempest-TestMinimumBasicScenario-1182327903 tempest-TestMinimumBasicScenario-1182327903-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-934605651" status: 202 len: 0 microversion: 2.1 time: 0.022323 Aug 04 14:07:30.348880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 707/1445] 10.222.0.43 () {58 vars in 1269 bytes} [Wed Aug 4 14:07:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-934605651 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:30.746526 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9d900e0b-49ce-46d1-b9d1-d2ec37fc27a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:30.747441 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9d900e0b-49ce-46d1-b9d1-d2ec37fc27a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:30.756720 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d900e0b-49ce-46d1-b9d1-d2ec37fc27a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:30.758535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d900e0b-49ce-46d1-b9d1-d2ec37fc27a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:30.759342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d900e0b-49ce-46d1-b9d1-d2ec37fc27a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:30.759855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9d900e0b-49ce-46d1-b9d1-d2ec37fc27a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:30.856904 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9d900e0b-49ce-46d1-b9d1-d2ec37fc27a6 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 33366 microversion: 2.1 time: 0.113829 Aug 04 14:07:30.857760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 739/1446] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:30 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 33366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:31.284439 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:31.285025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:31.291300 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:31.291748 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:31.292544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:31.292974 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:31.418469 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:31.426901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:31.428509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:31.429659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f60fdd8d-3057-475a-9c3a-19d1767b06bb tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.149769 Aug 04 14:07:31.430247 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 708/1447] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:31 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:31.870662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3a367756-e0fb-4f26-b456-9bfc9c1513bf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:31.871651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3a367756-e0fb-4f26-b456-9bfc9c1513bf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:31.879365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a367756-e0fb-4f26-b456-9bfc9c1513bf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:31.879821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a367756-e0fb-4f26-b456-9bfc9c1513bf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:31.880659 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a367756-e0fb-4f26-b456-9bfc9c1513bf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:31.881090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3a367756-e0fb-4f26-b456-9bfc9c1513bf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:31.985533 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3a367756-e0fb-4f26-b456-9bfc9c1513bf tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 34200 microversion: 2.1 time: 0.118736 Aug 04 14:07:31.987318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 740/1448] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:31 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 34200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:32.447829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:32.448593 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:32.454853 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:32.455745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:32.456612 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:32.457036 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:32.577692 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:32.597120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:32.598711 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:32.603113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-cae69d11-a16c-48e1-a4dd-28e946fb5d5d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.156431 Aug 04 14:07:32.604033 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 709/1449] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:32 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:32.998699 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1735a27c-4cec-4482-ae15-02b8d90de9ed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:32.999897 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1735a27c-4cec-4482-ae15-02b8d90de9ed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:33.007210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1735a27c-4cec-4482-ae15-02b8d90de9ed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:33.007660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1735a27c-4cec-4482-ae15-02b8d90de9ed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:33.008479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1735a27c-4cec-4482-ae15-02b8d90de9ed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:33.008908 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1735a27c-4cec-4482-ae15-02b8d90de9ed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:33.624348 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:33.626430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:33.635535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:33.636515 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:33.637446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:33.637998 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:33.644492 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1735a27c-4cec-4482-ae15-02b8d90de9ed tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 35794 microversion: 2.1 time: 0.649563 Aug 04 14:07:33.646572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 741/1450] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:32 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 35794 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:33.850809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:33.858680 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:33.860265 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:33.861809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-433d3062-082c-4f39-9276-2f8ff58b70ad tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.243919 Aug 04 14:07:33.862600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 710/1451] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:33 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:34.659411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-baf2e93c-01f8-4eee-b6c4-f08674e7975a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:34.660392 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-baf2e93c-01f8-4eee-b6c4-f08674e7975a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:34.667116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baf2e93c-01f8-4eee-b6c4-f08674e7975a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:34.667639 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baf2e93c-01f8-4eee-b6c4-f08674e7975a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:34.668653 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baf2e93c-01f8-4eee-b6c4-f08674e7975a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:34.669218 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-baf2e93c-01f8-4eee-b6c4-f08674e7975a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:34.803538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-baf2e93c-01f8-4eee-b6c4-f08674e7975a tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 37120 microversion: 2.1 time: 0.148897 Aug 04 14:07:34.804206 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 742/1452] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:34 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 37120 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:34.880544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:34.881185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:34.887066 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:34.887512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:34.888310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:34.888763 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:35.010540 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:35.018670 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:35.020166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:35.021339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-932e5ddb-adea-49ad-baef-4bc8a35bd3b8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1746 microversion: 2.20 time: 0.144594 Aug 04 14:07:35.021900 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 711/1453] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:34 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1746 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:35.816355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7f1eb3d4-52c0-450d-a3e8-58f739622c7d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:35.817385 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7f1eb3d4-52c0-450d-a3e8-58f739622c7d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:35.823968 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f1eb3d4-52c0-450d-a3e8-58f739622c7d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:35.824722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f1eb3d4-52c0-450d-a3e8-58f739622c7d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:35.825494 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f1eb3d4-52c0-450d-a3e8-58f739622c7d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:35.825924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7f1eb3d4-52c0-450d-a3e8-58f739622c7d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:35.928840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7f1eb3d4-52c0-450d-a3e8-58f739622c7d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 38261 microversion: 2.1 time: 0.116562 Aug 04 14:07:35.929820 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 743/1454] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:35 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 38261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:36.039992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:36.040689 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:36.047038 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:36.047768 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:36.048907 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:36.049712 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:36.199921 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:36.208672 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:36.210182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:36.211627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1c0432e0-c102-47ff-b1cf-971d4ddc6b0d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1746 microversion: 2.20 time: 0.175725 Aug 04 14:07:36.212415 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 712/1455] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:36 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:36.942433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d95202c8-b3fd-41e7-b5d3-a31731131d23 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:36.943528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d95202c8-b3fd-41e7-b5d3-a31731131d23 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:36.950918 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d95202c8-b3fd-41e7-b5d3-a31731131d23 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:36.951295 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d95202c8-b3fd-41e7-b5d3-a31731131d23 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:36.952320 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d95202c8-b3fd-41e7-b5d3-a31731131d23 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:36.952760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d95202c8-b3fd-41e7-b5d3-a31731131d23 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:37.059520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d95202c8-b3fd-41e7-b5d3-a31731131d23 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 38261 microversion: 2.1 time: 0.121565 Aug 04 14:07:37.063602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 744/1456] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:36 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 38261 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:37.230317 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:37.230931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:37.237369 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:37.237817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:37.238853 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:37.239295 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:37.453237 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:37.463693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:37.465506 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:37.466658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-91b018db-0edd-4f63-9706-d948eb11b827 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1746 microversion: 2.20 time: 0.240363 Aug 04 14:07:37.467213 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 713/1457] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:37 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1746 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:07:38.071329 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a39fb306-be11-4f81-a499-5b291e1ea91d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:38.073565 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a39fb306-be11-4f81-a499-5b291e1ea91d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:38.081915 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a39fb306-be11-4f81-a499-5b291e1ea91d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:38.082317 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a39fb306-be11-4f81-a499-5b291e1ea91d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:38.083523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a39fb306-be11-4f81-a499-5b291e1ea91d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:38.083523 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a39fb306-be11-4f81-a499-5b291e1ea91d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:38.110855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-34c1aacd-baad-4e93-a938-578f495de7bf req-a20632c0-a56a-44fc-9f16-6404a5628801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71864169-d3ea-45e4-8e11-0a36283b817c", "name": "network-vif-plugged", "status": "completed", "tag": "83351cb5-e13b-4211-b517-59a303fca918"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:38.112975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:07:38.112975 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:07:38.124095 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-34c1aacd-baad-4e93-a938-578f495de7bf req-a20632c0-a56a-44fc-9f16-6404a5628801 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:38.124890 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-34c1aacd-baad-4e93-a938-578f495de7bf req-a20632c0-a56a-44fc-9f16-6404a5628801 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:38.137310 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-34c1aacd-baad-4e93-a938-578f495de7bf req-a20632c0-a56a-44fc-9f16-6404a5628801 service nova] Creating event network-vif-plugged:83351cb5-e13b-4211-b517-59a303fca918 for instance 71864169-d3ea-45e4-8e11-0a36283b817c on hv-cinder-79264 Aug 04 14:07:38.145534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-34c1aacd-baad-4e93-a938-578f495de7bf req-a20632c0-a56a-44fc-9f16-6404a5628801 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037562 Aug 04 14:07:38.146913 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 714/1458] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:07:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:07:38.212884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a39fb306-be11-4f81-a499-5b291e1ea91d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 38261 microversion: 2.1 time: 0.145398 Aug 04 14:07:38.213528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 745/1459] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:38 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 38261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:38.485732 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:38.487875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:38.493817 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:38.494253 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:38.495013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:38.495436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:38.632812 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:38.640878 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:38.642431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:38.643557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a6d65eb3-74d0-4e6c-93d9-31f52c2121be tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1746 microversion: 2.20 time: 0.161965 Aug 04 14:07:38.644123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 715/1460] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:38 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:39.224799 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d776adb2-1369-43e9-847b-6274975d98c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:39.225787 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d776adb2-1369-43e9-847b-6274975d98c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:39.232262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d776adb2-1369-43e9-847b-6274975d98c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:39.232715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d776adb2-1369-43e9-847b-6274975d98c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:39.233486 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d776adb2-1369-43e9-847b-6274975d98c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:39.233917 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d776adb2-1369-43e9-847b-6274975d98c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:39.341969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d776adb2-1369-43e9-847b-6274975d98c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 38261 microversion: 2.1 time: 0.121173 Aug 04 14:07:39.342647 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 746/1461] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:39 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 38261 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:39.663395 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:39.663935 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:39.669689 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:39.670133 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:39.670895 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:39.671327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:39.793852 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:39.801709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:39.803197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:39.804360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b01de4c3-0102-4378-9125-f45ee60ab67f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1746 microversion: 2.20 time: 0.145639 Aug 04 14:07:39.804919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 716/1462] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:39 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1746 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:40.355238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cf2a81c2-a91b-4423-bc5e-9418981d23f7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:40.356237 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cf2a81c2-a91b-4423-bc5e-9418981d23f7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:40.362955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf2a81c2-a91b-4423-bc5e-9418981d23f7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:40.363422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf2a81c2-a91b-4423-bc5e-9418981d23f7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:40.364193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf2a81c2-a91b-4423-bc5e-9418981d23f7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:40.364713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cf2a81c2-a91b-4423-bc5e-9418981d23f7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:40.459168 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cf2a81c2-a91b-4423-bc5e-9418981d23f7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action" status: 200 len: 38392 microversion: 2.1 time: 0.107915 Aug 04 14:07:40.459854 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 747/1463] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:07:40 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/action => generated 38392 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:07:40.469879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ca1df7a4-d1b0-43a5-a8fd-d72f13de6932 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:40.470422 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ca1df7a4-d1b0-43a5-a8fd-d72f13de6932 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:40.478359 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a4-d1b0-43a5-a8fd-d72f13de6932 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:40.478801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a4-d1b0-43a5-a8fd-d72f13de6932 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:40.479570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a4-d1b0-43a5-a8fd-d72f13de6932 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:40.480003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a4-d1b0-43a5-a8fd-d72f13de6932 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:40.503868 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ca1df7a4-d1b0-43a5-a8fd-d72f13de6932 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/ips" status: 200 len: 146 microversion: 2.1 time: 0.037575 Aug 04 14:07:40.504463 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 717/1464] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Aug 4 14:07:40 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:40.822838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:40.823525 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:40.831086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:40.831585 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:40.832376 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:40.832818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:40.954080 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:40.962566 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:40.964056 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:40.965223 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b50020ef-1e1d-40c7-a524-3d09a2b91fc8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1746 microversion: 2.20 time: 0.146484 Aug 04 14:07:40.965780 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 748/1465] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:40 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:41.826848 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1749ffff-4d85-4667-ae70-601ff98d97df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1145a68e-0425-4810-9dc5-c658354cdcf5"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:41.827908 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1749ffff-4d85-4667-ae70-601ff98d97df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:41.843627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1749ffff-4d85-4667-ae70-601ff98d97df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:41.844668 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1749ffff-4d85-4667-ae70-601ff98d97df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:41.846182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1749ffff-4d85-4667-ae70-601ff98d97df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:41.846855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1749ffff-4d85-4667-ae70-601ff98d97df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:41.982676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:41.984000 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:41.990343 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:41.991115 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:41.992154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:41.992851 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:42.142825 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:42.151524 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:42.152988 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:42.154159 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2459d2b9-0136-4ead-85a1-bf6234e77d71 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.175156 Aug 04 14:07:42.154707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 749/1466] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:41 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:07:42.191815 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1749ffff-4d85-4667-ae70-601ff98d97df tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368694 Aug 04 14:07:42.192803 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 718/1467] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 14:07:41 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:07:43.174722 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:43.175947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:43.182324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:43.182772 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:43.183563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:43.183992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:43.322617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:43.332156 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:43.333944 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:43.335289 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0270d147-02b5-43b4-9980-2dc5b6193c96 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.165239 Aug 04 14:07:43.335846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 750/1468] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:43 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:44.354117 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:44.354802 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:44.364367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:44.365186 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:44.366232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:44.366887 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:44.529981 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:44.539542 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:44.541220 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:44.542442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-20d7baee-a171-4d72-8561-576957aaad57 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.192836 Aug 04 14:07:44.543344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 719/1469] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:44 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:45.562242 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:45.563473 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:45.570316 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:45.570907 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:45.571893 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:45.572610 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:45.711778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:45.723055 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:45.724855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:45.726004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e8ae93cf-5b07-4534-a07f-612815028211 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.168143 Aug 04 14:07:45.727110 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 751/1470] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:45 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:46.745367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:46.746800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:46.753175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:46.753953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:46.754999 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:46.755727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:46.887754 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:46.896321 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:46.898064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:46.899400 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b3846807-38d3-4535-b2cc-6d9c764efbb6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.157950 Aug 04 14:07:46.899964 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 720/1471] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:46 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:47.920972 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:47.921557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:47.929224 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:47.929960 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:47.930746 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:47.931173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:48.146107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:48.154120 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:48.155544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:48.156744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1f786516-2d73-48d3-9885-32db76646fc5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.239745 Aug 04 14:07:48.158820 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 752/1472] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:47 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:49.178620 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:49.179385 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:49.185727 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:49.186399 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:49.187276 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:49.187800 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:49.341662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:49.353029 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:49.356009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:49.357436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e37bdaa6-cf09-4147-8ac2-8499dc4942c0 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.184602 Aug 04 14:07:49.358018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 721/1473] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:49 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:49.750621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b8f34990-9190-48fb-8744-267b0f8baf94 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:49.753025 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b8f34990-9190-48fb-8744-267b0f8baf94 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:49.759507 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8f34990-9190-48fb-8744-267b0f8baf94 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:49.759955 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8f34990-9190-48fb-8744-267b0f8baf94 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:49.760769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8f34990-9190-48fb-8744-267b0f8baf94 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:49.761423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b8f34990-9190-48fb-8744-267b0f8baf94 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:49.794518 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b8f34990-9190-48fb-8744-267b0f8baf94 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047765 Aug 04 14:07:49.795469 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 753/1474] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Aug 4 14:07:49 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:49.805256 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3f8d4420-f073-45e8-a92b-39a26c2fa718 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:49.805825 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3f8d4420-f073-45e8-a92b-39a26c2fa718 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:49.813344 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3f8d4420-f073-45e8-a92b-39a26c2fa718 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:49.813875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3f8d4420-f073-45e8-a92b-39a26c2fa718 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:49.815429 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3f8d4420-f073-45e8-a92b-39a26c2fa718 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:49.815984 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3f8d4420-f073-45e8-a92b-39a26c2fa718 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:49.860082 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3f8d4420-f073-45e8-a92b-39a26c2fa718 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/1145a68e-0425-4810-9dc5-c658354cdcf5" status: 200 len: 194 microversion: 2.1 time: 0.058492 Aug 04 14:07:49.867570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 722/1475] 10.222.0.43 () {58 vars in 1413 bytes} [Wed Aug 4 14:07:49 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/1145a68e-0425-4810-9dc5-c658354cdcf5 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:50.381465 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:50.382444 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:50.389082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:50.389826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:50.390600 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:50.391038 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:50.537981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:50.550223 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:50.552719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:50.554436 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-96a98558-87d8-49d6-bd9e-9b18876471c7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.176727 Aug 04 14:07:50.555243 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 754/1476] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:50 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:51.269180 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4d50768d-fc15-4421-9c78-24522b03f2ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9bd314c-cde1-46fd-9f5c-2a73fc2f1978"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:51.271200 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4d50768d-fc15-4421-9c78-24522b03f2ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:51.278876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d50768d-fc15-4421-9c78-24522b03f2ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:51.279718 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d50768d-fc15-4421-9c78-24522b03f2ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:51.280830 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d50768d-fc15-4421-9c78-24522b03f2ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:51.281489 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4d50768d-fc15-4421-9c78-24522b03f2ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:51.573421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:51.574131 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:51.580880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:51.581416 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:51.582272 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:51.582703 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:51.665862 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4d50768d-fc15-4421-9c78-24522b03f2ee tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400875 Aug 04 14:07:51.671198 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 723/1477] 10.222.0.43 () {60 vars in 1323 bytes} [Wed Aug 4 14:07:51 2021] POST /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:51.771046 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:51.780755 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:51.783617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:51.785023 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-84af6992-3ee6-4d0a-bb0f-17d4b9a853f6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.216463 Aug 04 14:07:51.797583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 755/1478] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:51 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:07:52.805901 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:52.806582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:52.812583 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:52.813024 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:52.813776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:52.814696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:52.937598 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:52.946235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:52.947751 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:52.948912 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ecc99744-7cdc-47f9-80a9-085336e7aa11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1741 microversion: 2.20 time: 0.147560 Aug 04 14:07:52.949474 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 724/1479] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:52 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1741 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:53.967909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:53.968529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:53.977964 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:53.978680 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:53.979998 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:53.980370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:54.181735 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:54.193615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:54.196670 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:54.198801 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d917e2fa-8869-4a60-ac83-a5716efc25f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1723 microversion: 2.20 time: 0.234285 Aug 04 14:07:54.200090 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 756/1480] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:53 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:55.226387 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:55.227040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:55.233253 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:55.233696 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:55.234460 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:55.234891 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:55.358085 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:55.366271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:55.367779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:55.369048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-130c1b31-194b-49a3-96d7-6011d257d2f8 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1723 microversion: 2.20 time: 0.146435 Aug 04 14:07:55.369613 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 725/1481] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:55 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:56.262309 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-1241f32a-9f09-4e90-b7f0-940ab9955e27 req-c7b1f380-d111-419f-89e7-c1e1878a9b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71864169-d3ea-45e4-8e11-0a36283b817c", "name": "network-vif-unplugged", "status": "completed", "tag": "83351cb5-e13b-4211-b517-59a303fca918"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:56.263864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:07:56.263864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:07:56.271875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-1241f32a-9f09-4e90-b7f0-940ab9955e27 req-c7b1f380-d111-419f-89e7-c1e1878a9b34 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:56.272352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-1241f32a-9f09-4e90-b7f0-940ab9955e27 req-c7b1f380-d111-419f-89e7-c1e1878a9b34 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:56.284166 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-1241f32a-9f09-4e90-b7f0-940ab9955e27 req-c7b1f380-d111-419f-89e7-c1e1878a9b34 service nova] Creating event network-vif-unplugged:83351cb5-e13b-4211-b517-59a303fca918 for instance 71864169-d3ea-45e4-8e11-0a36283b817c on hv-cinder-79264 Aug 04 14:07:56.289058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-1241f32a-9f09-4e90-b7f0-940ab9955e27 req-c7b1f380-d111-419f-89e7-c1e1878a9b34 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154770 Aug 04 14:07:56.289655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 757/1482] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:07:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:56.386623 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:56.387226 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:56.393314 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:56.393764 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:56.394537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:56.394970 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:56.521342 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:56.529124 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:56.530614 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:56.531741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4441a1bd-058d-47c0-9c87-caf095af417d tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1726 microversion: 2.20 time: 0.148855 Aug 04 14:07:56.532317 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 726/1483] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:56 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:56.550850 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a60aa96b-798b-4c28-b047-265f70ec273e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55a6c157-8d85-486d-ae7f-036da9e4687a"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:56.552013 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a60aa96b-798b-4c28-b047-265f70ec273e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:56.558059 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a60aa96b-798b-4c28-b047-265f70ec273e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:56.558497 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a60aa96b-798b-4c28-b047-265f70ec273e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:56.559259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a60aa96b-798b-4c28-b047-265f70ec273e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:56.559683 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a60aa96b-798b-4c28-b047-265f70ec273e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:56.815324 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a60aa96b-798b-4c28-b047-265f70ec273e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.269222 Aug 04 14:07:56.815925 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 758/1484] 10.222.0.43 () {62 vars in 1364 bytes} [Wed Aug 4 14:07:56 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/os-volume_attachments => generated 188 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:07:56.880938 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3301e530-9ab7-4f2a-bd48-de28f45672de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:56.881421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3301e530-9ab7-4f2a-bd48-de28f45672de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:56.887159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3301e530-9ab7-4f2a-bd48-de28f45672de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:56.887604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3301e530-9ab7-4f2a-bd48-de28f45672de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:56.888394 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3301e530-9ab7-4f2a-bd48-de28f45672de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:56.888819 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3301e530-9ab7-4f2a-bd48-de28f45672de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:57.145749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3301e530-9ab7-4f2a-bd48-de28f45672de tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "DELETE /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/os-volume_attachments/55a6c157-8d85-486d-ae7f-036da9e4687a" status: 202 len: 0 microversion: 2.20 time: 0.268665 Aug 04 14:07:57.146366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 727/1485] 10.222.0.43 () {60 vars in 1457 bytes} [Wed Aug 4 14:07:56 2021] DELETE /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/os-volume_attachments/55a6c157-8d85-486d-ae7f-036da9e4687a => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:07:57.213769 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:57.214322 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:57.220041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:57.220658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:57.221601 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:57.222031 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:57.298718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [09eb74c7-0cfa-4572-81f6-0ded4c000848] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:07:58.316812 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [09eb74c7-0cfa-4572-81f6-0ded4c000848] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38494. Aug 04 14:07:58.320252 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-3d60c990-32f7-4ea5-8344-da571a749a45 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action" status: 202 len: 0 microversion: 2.20 time: 1.110201 Aug 04 14:07:58.321024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 759/1486] 10.222.0.43 () {62 vars in 1319 bytes} [Wed Aug 4 14:07:57 2021] POST /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c/action => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:07:58.336113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:58.336753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:58.343534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:58.344291 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:58.345075 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:58.346358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:58.482822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:58.491235 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:58.492776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:58.493879 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a7a35fde-7314-4618-b21f-8194a2bbc125 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1674 microversion: 2.20 time: 0.162151 Aug 04 14:07:58.494430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 728/1487] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:58 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:59.512478 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:59.513082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:07:59.519889 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:59.520358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:59.521125 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:07:59.521558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:07:59.645355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:59.654348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:59.655847 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:59.657016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-53196ab2-9e79-4f23-88d2-31503dc4538e tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.148441 Aug 04 14:07:59.657570 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 760/1488] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:07:59 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:00.240364 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8da391b1-b259-46dd-99e1-48818729ac61 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:00.241349 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8da391b1-b259-46dd-99e1-48818729ac61 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:00.247544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8da391b1-b259-46dd-99e1-48818729ac61 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:00.248010 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8da391b1-b259-46dd-99e1-48818729ac61 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:00.248811 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8da391b1-b259-46dd-99e1-48818729ac61 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:00.249237 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8da391b1-b259-46dd-99e1-48818729ac61 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:00.280797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8da391b1-b259-46dd-99e1-48818729ac61 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045040 Aug 04 14:08:00.281365 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 729/1489] 10.222.0.43 () {58 vars in 1302 bytes} [Wed Aug 4 14:08:00 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:00.533487 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5ddf51ab-ba82-465f-98b1-3322361732d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:00.534061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5ddf51ab-ba82-465f-98b1-3322361732d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:00.539702 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ddf51ab-ba82-465f-98b1-3322361732d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:00.540146 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ddf51ab-ba82-465f-98b1-3322361732d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:00.540947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ddf51ab-ba82-465f-98b1-3322361732d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:00.541370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ddf51ab-ba82-465f-98b1-3322361732d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:00.571829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5ddf51ab-ba82-465f-98b1-3322361732d5 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/1145a68e-0425-4810-9dc5-c658354cdcf5" status: 200 len: 194 microversion: 2.1 time: 0.042087 Aug 04 14:08:00.572438 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 761/1490] 10.222.0.43 () {58 vars in 1413 bytes} [Wed Aug 4 14:08:00 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/1145a68e-0425-4810-9dc5-c658354cdcf5 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:00.582183 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-68b33f15-1d49-4526-a6b0-c01d4194b478 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:00.582678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-68b33f15-1d49-4526-a6b0-c01d4194b478 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:00.588469 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68b33f15-1d49-4526-a6b0-c01d4194b478 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:00.588916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68b33f15-1d49-4526-a6b0-c01d4194b478 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:00.589687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68b33f15-1d49-4526-a6b0-c01d4194b478 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:00.590115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-68b33f15-1d49-4526-a6b0-c01d4194b478 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:00.676362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:00.677029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:00.677269 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-68b33f15-1d49-4526-a6b0-c01d4194b478 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lazy-loading 'services' on Instance uuid 5430baac-88c3-40da-84c8-caffc9d919ea {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:08:00.682980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:00.683451 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:00.684303 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:00.684671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:00.745893 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-68b33f15-1d49-4526-a6b0-c01d4194b478 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/1145a68e-0425-4810-9dc5-c658354cdcf5" status: 202 len: 0 microversion: 2.1 time: 0.167299 Aug 04 14:08:00.746601 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 730/1491] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:08:00 2021] DELETE /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/1145a68e-0425-4810-9dc5-c658354cdcf5 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:08:00.819627 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:00.828188 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:00.830471 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:00.831618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e60f8962-70c0-4749-b263-f7c212283709 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.159216 Aug 04 14:08:00.832167 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 762/1492] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:00 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:08:01.851047 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:01.851730 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:01.858009 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:01.858390 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:01.859163 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:01.859647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:01.988948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:01.996708 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:01.998218 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:01.999354 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-34b8b94a-d4b3-4f7f-90bc-061779e19003 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.152333 Aug 04 14:08:01.999920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 731/1493] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:01 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:03.017433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:03.018463 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:03.023880 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:03.024388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:03.025163 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:03.025593 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:03.159435 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:03.167417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:03.168949 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:03.170101 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ea85bf17-4ebc-4a4e-853b-7d3a50b9600f tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.156535 Aug 04 14:08:03.170651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 763/1494] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:03 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:04.192241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:04.192793 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:04.198537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:04.198977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:04.199729 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:04.200452 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:04.321442 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:04.330361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:04.331877 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:04.333174 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-adb5f177-bc3f-4ab4-ab02-9519d75052d6 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.145097 Aug 04 14:08:04.333739 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 732/1495] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:04 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:05.352162 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:05.352730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:05.358732 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:05.359265 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:05.360137 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:05.360603 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:05.493934 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:05.502651 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:05.504202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:05.505427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a88e9ede-c76d-490c-874e-08a498b65e83 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.157095 Aug 04 14:08:05.506330 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 764/1496] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:05 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:06.526707 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:06.527357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:06.533943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:06.534386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:06.535167 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:06.535592 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:06.710618 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:06.720363 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:06.723345 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:06.725350 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-92e0b222-d69e-40d6-8fa6-9b5ff2f593e9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.202700 Aug 04 14:08:06.726847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 733/1497] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:06 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:07.745705 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:07.746306 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:07.752968 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:07.753410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:07.754405 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:07.755262 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:07.888077 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:07.897456 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:07.898989 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:07.900130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f995cd05-7a61-463f-9a20-7dc92e851ec1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.158312 Aug 04 14:08:07.900713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 765/1498] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:07 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:08.918753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:08.919342 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:08.926109 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:08.926551 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:08.927309 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:08.927776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:09.056738 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:09.064919 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:09.066408 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:09.067527 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e539cb2b-f20c-4121-893b-eea2d2a02d40 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.152506 Aug 04 14:08:09.068091 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 734/1499] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:08 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:10.086508 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:10.087156 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:10.093407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:10.093872 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:10.094655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:10.095093 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:10.226197 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:10.234424 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:10.236591 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:10.237892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9480c075-dfd3-4272-a50a-ed16eaa444c5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.155111 Aug 04 14:08:10.238479 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 766/1500] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:10 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:11.256410 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:11.257260 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:11.263052 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:11.263501 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:11.264318 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:11.264753 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:11.394658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:11.403629 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:11.405336 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:11.406847 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-67383f93-2a67-42de-b176-acc7b454e614 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.154422 Aug 04 14:08:11.407685 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 735/1501] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:11 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:12.425608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:12.426359 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:12.432140 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:12.432624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:12.433604 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:12.433950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:12.572760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:12.581905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:12.583629 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:12.584837 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-20ed6243-1aaf-41b9-b403-8deccf82092b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.164007 Aug 04 14:08:12.585412 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 767/1502] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:12 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:13.602869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:13.603479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:13.609492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:13.609945 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:13.610870 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:13.611435 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:13.747724 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:13.756200 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:13.757735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:13.758868 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e7d9145c-63cb-4b5d-b2b9-33db939b5224 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.159818 Aug 04 14:08:13.759431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 736/1503] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:13 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:14.777372 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:14.778018 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:14.785165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:14.785603 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:14.786363 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:14.786787 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:14.913325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:14.921348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:14.922824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:14.924427 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-89e9e5f6-d044-44d5-9682-1164bad19c09 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.150460 Aug 04 14:08:14.925193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 768/1504] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:14 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:15.943219 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:15.943786 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:15.949693 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:15.950139 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:15.951187 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:15.951615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:16.070512 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:16.078389 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:16.080792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:16.081969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-580a0746-51e9-4497-ade2-aab0d3ad1042 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.143296 Aug 04 14:08:16.082570 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 737/1505] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:15 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:17.099931 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:17.100696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:17.107273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:17.107717 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:17.108509 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:17.108938 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:17.233411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:17.241689 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:17.243182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:17.244342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ba4838f2-6223-454d-8731-04624b08bec9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.148122 Aug 04 14:08:17.244887 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 769/1506] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:17 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:18.262903 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:18.263494 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:18.269679 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:18.270116 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:18.270945 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:18.271369 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:18.392075 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:18.400058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:18.401600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:18.402738 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-32a124cb-71ab-4af0-8171-17b3d0569b11 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.143629 Aug 04 14:08:18.403309 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 738/1507] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:18 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:19.421980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:19.422584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:19.429024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:19.429544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:19.430368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:19.430857 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:19.553520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:19.561778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:19.563876 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:19.566177 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a1886fe1-0775-4ce3-9237-216ef4abf677 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.147914 Aug 04 14:08:19.566738 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 770/1508] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:19 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:20.584808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:20.585355 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:20.591175 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:20.591621 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:20.592405 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:20.592832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:20.724475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:20.732405 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:20.733977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:20.735144 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-03e1383d-0d48-49f4-8eda-3f5a88f70773 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.154318 Aug 04 14:08:20.735698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 739/1509] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:20 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:20.951082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-32db527d-2648-49d1-948f-b2d33bf6b8ac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:20.951790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-32db527d-2648-49d1-948f-b2d33bf6b8ac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:20.958432 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-32db527d-2648-49d1-948f-b2d33bf6b8ac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:20.958874 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-32db527d-2648-49d1-948f-b2d33bf6b8ac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:20.959634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-32db527d-2648-49d1-948f-b2d33bf6b8ac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:20.960060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-32db527d-2648-49d1-948f-b2d33bf6b8ac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:20.989228 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-32db527d-2648-49d1-948f-b2d33bf6b8ac tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/e9bd314c-cde1-46fd-9f5c-2a73fc2f1978" status: 200 len: 194 microversion: 2.1 time: 0.042102 Aug 04 14:08:20.989789 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 771/1510] 10.222.0.43 () {58 vars in 1413 bytes} [Wed Aug 4 14:08:20 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/e9bd314c-cde1-46fd-9f5c-2a73fc2f1978 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:20.999018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1b96be66-5780-48d1-a4c4-16cad292df81 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:20.999509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1b96be66-5780-48d1-a4c4-16cad292df81 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:21.005650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b96be66-5780-48d1-a4c4-16cad292df81 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:21.006094 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b96be66-5780-48d1-a4c4-16cad292df81 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:21.006851 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b96be66-5780-48d1-a4c4-16cad292df81 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:21.007281 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1b96be66-5780-48d1-a4c4-16cad292df81 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:21.089170 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-1b96be66-5780-48d1-a4c4-16cad292df81 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lazy-loading 'services' on Instance uuid 5430baac-88c3-40da-84c8-caffc9d919ea {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:08:21.153951 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1b96be66-5780-48d1-a4c4-16cad292df81 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/e9bd314c-cde1-46fd-9f5c-2a73fc2f1978" status: 202 len: 0 microversion: 2.1 time: 0.158287 Aug 04 14:08:21.154472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 740/1511] 10.222.0.43 () {58 vars in 1416 bytes} [Wed Aug 4 14:08:20 2021] DELETE /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea/os-volume_attachments/e9bd314c-cde1-46fd-9f5c-2a73fc2f1978 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:08:21.754578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:21.755534 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:21.763341 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:21.763838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:21.764661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:21.765531 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:21.891793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:21.900163 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:21.901691 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:21.902824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-309090c6-cae4-4e3c-8845-94a8008567e7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.152983 Aug 04 14:08:21.903377 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 772/1512] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:21 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:22.480020 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-8556d2e6-a447-42c3-81a4-05263c95a225 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:22.480589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8556d2e6-a447-42c3-81a4-05263c95a225 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:22.486911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8556d2e6-a447-42c3-81a4-05263c95a225 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:22.487349 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8556d2e6-a447-42c3-81a4-05263c95a225 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:22.488115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8556d2e6-a447-42c3-81a4-05263c95a225 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:22.488567 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-8556d2e6-a447-42c3-81a4-05263c95a225 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:22.512714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-8556d2e6-a447-42c3-81a4-05263c95a225 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:08:22.586887 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-8556d2e6-a447-42c3-81a4-05263c95a225 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 204 len: 0 microversion: 2.1 time: 0.110456 Aug 04 14:08:22.587594 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 741/1513] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:08:22 2021] DELETE /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:08:22.596210 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f5446985-e014-432f-8444-889cef1e5ccc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:22.596844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-f5446985-e014-432f-8444-889cef1e5ccc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:22.602911 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f5446985-e014-432f-8444-889cef1e5ccc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:22.603365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f5446985-e014-432f-8444-889cef1e5ccc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:22.604147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f5446985-e014-432f-8444-889cef1e5ccc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:22.604616 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-f5446985-e014-432f-8444-889cef1e5ccc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:22.727990 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-f5446985-e014-432f-8444-889cef1e5ccc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:22.735344 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f5446985-e014-432f-8444-889cef1e5ccc tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1674 microversion: 2.1 time: 0.143419 Aug 04 14:08:22.736638 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 773/1514] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:22 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1674 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:22.921244 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:22.921920 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:22.928684 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:22.929120 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:22.929873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:22.930297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:23.050315 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:23.057995 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:23.059488 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:23.060652 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ea90bce1-1f2e-4364-9e4e-7a34d2647368 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.143514 Aug 04 14:08:23.061219 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 742/1515] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:22 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:23.753760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cafb91d7-851c-4dbd-ab01-f143f9c41c9d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:23.754365 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cafb91d7-851c-4dbd-ab01-f143f9c41c9d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:23.760301 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cafb91d7-851c-4dbd-ab01-f143f9c41c9d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:23.760744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cafb91d7-851c-4dbd-ab01-f143f9c41c9d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:23.761509 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cafb91d7-851c-4dbd-ab01-f143f9c41c9d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:23.761935 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cafb91d7-851c-4dbd-ab01-f143f9c41c9d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:23.886681 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-cafb91d7-851c-4dbd-ab01-f143f9c41c9d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:23.893867 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cafb91d7-851c-4dbd-ab01-f143f9c41c9d tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1674 microversion: 2.1 time: 0.144497 Aug 04 14:08:23.894422 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 774/1516] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:23 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:24.078709 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:24.079237 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:24.085058 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:24.085500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:24.086285 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:24.086713 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:24.208910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:24.216721 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:24.218213 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:24.219351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ec143adb-6864-428f-ade2-c5d60bec0655 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.144692 Aug 04 14:08:24.219922 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 743/1517] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:24 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:24.910961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-28fc5040-f68a-4c9d-bc18-7203d240eb38 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:24.911549 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-28fc5040-f68a-4c9d-bc18-7203d240eb38 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:24.917353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28fc5040-f68a-4c9d-bc18-7203d240eb38 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:24.917801 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28fc5040-f68a-4c9d-bc18-7203d240eb38 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:24.918564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28fc5040-f68a-4c9d-bc18-7203d240eb38 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:24.919040 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-28fc5040-f68a-4c9d-bc18-7203d240eb38 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:25.039062 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-28fc5040-f68a-4c9d-bc18-7203d240eb38 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:25.046389 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-28fc5040-f68a-4c9d-bc18-7203d240eb38 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1674 microversion: 2.1 time: 0.139536 Aug 04 14:08:25.046948 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 775/1518] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:24 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1674 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:25.238446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:25.239052 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:25.245446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:25.245926 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:25.246701 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:25.247129 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:25.375637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:25.383664 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:25.385187 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:25.386358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bfd58946-ba39-42a1-bac2-4448875560a3 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.152185 Aug 04 14:08:25.386923 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 744/1519] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:25 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:26.063378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-4f341ee9-bcb9-4af9-aee5-12f6a9388b6c req-69a1b5e9-8dba-4fd8-8bb3-3093be3d27fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5430baac-88c3-40da-84c8-caffc9d919ea", "name": "network-vif-deleted", "tag": "e6a078d9-303d-4b39-8a39-f1f3a2797f43"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:26.064035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-38ffd4ee-a848-40b7-ac05-1e4109ffa097 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:26.064991 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-38ffd4ee-a848-40b7-ac05-1e4109ffa097 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:26.067161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:08:26.067161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:08:26.072095 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38ffd4ee-a848-40b7-ac05-1e4109ffa097 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:26.072829 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38ffd4ee-a848-40b7-ac05-1e4109ffa097 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:26.073792 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38ffd4ee-a848-40b7-ac05-1e4109ffa097 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:26.074388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-38ffd4ee-a848-40b7-ac05-1e4109ffa097 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:26.081963 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-4f341ee9-bcb9-4af9-aee5-12f6a9388b6c req-69a1b5e9-8dba-4fd8-8bb3-3093be3d27fc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:26.082554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-4f341ee9-bcb9-4af9-aee5-12f6a9388b6c req-69a1b5e9-8dba-4fd8-8bb3-3093be3d27fc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:26.108624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-4f341ee9-bcb9-4af9-aee5-12f6a9388b6c req-69a1b5e9-8dba-4fd8-8bb3-3093be3d27fc service nova] Creating event network-vif-deleted:e6a078d9-303d-4b39-8a39-f1f3a2797f43 for instance 5430baac-88c3-40da-84c8-caffc9d919ea on hv-cinder-79264 Aug 04 14:08:26.121189 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-4f341ee9-bcb9-4af9-aee5-12f6a9388b6c req-69a1b5e9-8dba-4fd8-8bb3-3093be3d27fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128971 Aug 04 14:08:26.122406 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 776/1520] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:08:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:26.159339 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-38ffd4ee-a848-40b7-ac05-1e4109ffa097 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c2439b760c4abaa9cd6a43408bf092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd1f57702c84fa0a573ef2d56077e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:26.169788 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-38ffd4ee-a848-40b7-ac05-1e4109ffa097 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 200 len: 1322 microversion: 2.1 time: 0.109837 Aug 04 14:08:26.170375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 745/1521] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:26 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 1322 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:26.406811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:26.408136 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:26.415538 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:26.415948 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:26.416756 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:26.417182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:26.505172 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-06b37be5-432f-4f35-a8b6-e1098a7d4e2e req-a9bbb9cb-6d60-42e2-a77c-8e2421b22940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71864169-d3ea-45e4-8e11-0a36283b817c", "name": "network-vif-plugged", "status": "completed", "tag": "83351cb5-e13b-4211-b517-59a303fca918"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:26.507809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:08:26.507809 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:08:26.515992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-06b37be5-432f-4f35-a8b6-e1098a7d4e2e req-a9bbb9cb-6d60-42e2-a77c-8e2421b22940 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:26.516479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-06b37be5-432f-4f35-a8b6-e1098a7d4e2e req-a9bbb9cb-6d60-42e2-a77c-8e2421b22940 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:26.529866 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-06b37be5-432f-4f35-a8b6-e1098a7d4e2e req-a9bbb9cb-6d60-42e2-a77c-8e2421b22940 service nova] Creating event network-vif-plugged:83351cb5-e13b-4211-b517-59a303fca918 for instance 71864169-d3ea-45e4-8e11-0a36283b817c on hv-cinder-79264 Aug 04 14:08:26.536615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-06b37be5-432f-4f35-a8b6-e1098a7d4e2e req-a9bbb9cb-6d60-42e2-a77c-8e2421b22940 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035307 Aug 04 14:08:26.537779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 746/1522] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:08:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:08:26.562146 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:26.574054 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:26.576615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:26.578194 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b7e973cd-ace7-4268-931e-a5817b42eeb9 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.175364 Aug 04 14:08:26.578905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 777/1523] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:26 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:27.187353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:27.188048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:27.194860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:27.195302 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:27.196102 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:27.196557 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:27.210675 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] HTTP exception thrown: Instance 5430baac-88c3-40da-84c8-caffc9d919ea could not be found. Aug 04 14:08:27.211263 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Returning 404 to user: Instance 5430baac-88c3-40da-84c8-caffc9d919ea could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:27.212123 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d8e9f887-ac88-4af9-8aa1-321fab41d2dd tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 404 len: 111 microversion: 2.1 time: 0.028977 Aug 04 14:08:27.212691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 747/1524] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:27 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:27.221370 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e10eaa84-c83e-4a53-a5a5-905e75ce90c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '.version_select at 0x7efe8100d820>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:27.224572 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e10eaa84-c83e-4a53-a5a5-905e75ce90c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [b2c7237c-c5a8-45d1-8786-d8fffbe44af3] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:08:27.596685 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:27.597295 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:27.603126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:27.603569 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:27.604358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:27.604824 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:27.727762 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:27.736328 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:27.738216 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:27.739493 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-251a394d-82fa-4698-be7c-f483d5e8c900 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.147275 Aug 04 14:08:27.740629 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 748/1525] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:27 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:08:28.241518 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [None req-e10eaa84-c83e-4a53-a5a5-905e75ce90c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [b2c7237c-c5a8-45d1-8786-d8fffbe44af3] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38698. Aug 04 14:08:28.260232 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e10eaa84-c83e-4a53-a5a5-905e75ce90c4 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495854005" status: 202 len: 0 microversion: 2.1 time: 1.043025 Aug 04 14:08:28.260818 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 778/1526] 10.222.0.43 () {58 vars in 1218 bytes} [Wed Aug 4 14:08:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495854005 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:08:28.758430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:28.758942 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:28.765138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:28.765563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:28.766534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:28.767793 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:28.908544 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:28.918780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:28.920692 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:28.922297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3b752d9f-0e73-4cb6-9a0b-f20f2cc02b28 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1732 microversion: 2.20 time: 0.167640 Aug 04 14:08:28.932917 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 749/1527] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:28 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:29.942174 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:29.942776 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:29.948608 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:29.949051 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:29.949846 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:29.950271 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:30.078147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:30.086509 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:30.088081 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:30.090015 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c76d48a5-b718-4e4c-a781-483ce43aefea tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1719 microversion: 2.20 time: 0.151675 Aug 04 14:08:30.090576 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 779/1528] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:08:29 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:08:31.220627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:31.221191 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:31.226910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:31.227356 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:31.228148 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:31.228604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:31.242139 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] HTTP exception thrown: Instance 5430baac-88c3-40da-84c8-caffc9d919ea could not be found. Aug 04 14:08:31.242722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Returning 404 to user: Instance 5430baac-88c3-40da-84c8-caffc9d919ea could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:31.243534 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-328d0beb-4afe-4792-a012-b5092088f8e7 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 404 len: 111 microversion: 2.1 time: 0.027137 Aug 04 14:08:31.244057 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 750/1529] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:08:31 2021] DELETE /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:31.251975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:31.252632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 5430baac-88c3-40da-84c8-caffc9d919ea] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:31.258579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:31.259022 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:31.259791 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:31.260237 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:31.273557 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] HTTP exception thrown: Instance 5430baac-88c3-40da-84c8-caffc9d919ea could not be found. Aug 04 14:08:31.274147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Returning 404 to user: Instance 5430baac-88c3-40da-84c8-caffc9d919ea could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:31.275031 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d7411a74-d9c1-4635-853e-f381c69fe5e3 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea" status: 404 len: 111 microversion: 2.1 time: 0.026815 Aug 04 14:08:31.275510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 780/1530] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:31 2021] GET /compute/v2.1/servers/5430baac-88c3-40da-84c8-caffc9d919ea => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:32.407560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:32.408071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:32.413985 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:32.414450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:32.415229 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:32.415643 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:32.428996 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] HTTP exception thrown: Instance 2c1349a3-e392-480b-84ed-d851137f5a0c could not be found. Aug 04 14:08:32.429577 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Returning 404 to user: Instance 2c1349a3-e392-480b-84ed-d851137f5a0c could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:32.430385 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2c9fa06b-8703-4e54-b2ea-8d4d610d0040 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 404 len: 111 microversion: 2.1 time: 0.026550 Aug 04 14:08:32.430906 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 751/1531] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:08:32 2021] DELETE /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:32.438713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:32.439326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] [instance: 2c1349a3-e392-480b-84ed-d851137f5a0c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:32.446042 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:32.446502 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:32.447283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:32.447751 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:32.461741 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] HTTP exception thrown: Instance 2c1349a3-e392-480b-84ed-d851137f5a0c could not be found. Aug 04 14:08:32.462353 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] Returning 404 to user: Instance 2c1349a3-e392-480b-84ed-d851137f5a0c could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:32.463186 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-432873c4-38c3-4693-980d-c1efe38f33b0 tempest-AttachVolumeTestJSON-1429482819 tempest-AttachVolumeTestJSON-1429482819-project] 10.222.0.43 "GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c" status: 404 len: 111 microversion: 2.1 time: 0.028185 Aug 04 14:08:32.463730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 781/1532] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:32 2021] GET /compute/v2.1/servers/2c1349a3-e392-480b-84ed-d851137f5a0c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:37.070822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e173dcec-9cc4-4b36-b8b2-f6bf1335ed2d tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Action: 'create', calling method: .version_select at 0x7efe7c2efca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-491008076"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:37.359231 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e173dcec-9cc4-4b36-b8b2-f6bf1335ed2d tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.395374 Aug 04 14:08:37.359938 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 752/1533] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Aug 4 14:08:36 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 397 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 14:08:37.371212 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fecd9181-562b-469a-9e61-b9de2dae38e3 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe810775e0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:37.423010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fecd9181-562b-469a-9e61-b9de2dae38e3 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85" status: 200 len: 344 microversion: 2.1 time: 0.055375 Aug 04 14:08:37.423597 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 782/1534] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:08:37 2021] GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:38.435380 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-874f35f4-32fc-4918-a117-4f50b16d05b5 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c2cc4c0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:38.486768 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-874f35f4-32fc-4918-a117-4f50b16d05b5 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85" status: 200 len: 345 microversion: 2.1 time: 0.054935 Aug 04 14:08:38.487364 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 753/1535] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:08:38 2021] GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:38.498621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e52cbb4f-22d5-4876-92e4-c2de7e849c1d tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Action: 'create', calling method: .version_select at 0x7efe7c4c6af0>, body: {"snapshot": {"volume_id": "57e4044c-f4cc-428f-8526-10d4cc5dcc85", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1922934628"}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:38.635969 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e52cbb4f-22d5-4876-92e4-c2de7e849c1d tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.140902 Aug 04 14:08:38.640251 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 783/1536] 10.222.0.43 () {60 vars in 1162 bytes} [Wed Aug 4 14:08:38 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:38.649186 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2c3378fa-ef05-4423-82c6-46f79853bf84 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c31fc10>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:38.680713 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2c3378fa-ef05-4423-82c6-46f79853bf84 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 200 len: 287 microversion: 2.1 time: 0.035390 Aug 04 14:08:38.681275 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 754/1537] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:38 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:38.691005 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1647d300-5bdb-4b01-94c3-4120c0525a63 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe8108d550>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:38.720401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1647d300-5bdb-4b01-94c3-4120c0525a63 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033048 Aug 04 14:08:38.720967 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 784/1538] 10.222.0.43 () {58 vars in 1140 bytes} [Wed Aug 4 14:08:38 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:38.731453 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-5a2e3b35-b7ec-4524-99f4-83dfee6a5763 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c3c0670>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:38.759766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-5a2e3b35-b7ec-4524-99f4-83dfee6a5763 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 200 len: 287 microversion: 2.1 time: 0.031976 Aug 04 14:08:38.760353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 755/1539] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:38 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:39.771470 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a12d77d0-48be-4c4e-8b09-aab25be0409b tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe81080790>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:39.799602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a12d77d0-48be-4c4e-8b09-aab25be0409b tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 200 len: 287 microversion: 2.1 time: 0.032475 Aug 04 14:08:39.800864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 785/1540] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:39 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:40.811801 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-02bb1705-bd22-452b-988d-d022f7e7c5be tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c2eff70>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:40.841351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-02bb1705-bd22-452b-988d-d022f7e7c5be tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 200 len: 287 microversion: 2.1 time: 0.033196 Aug 04 14:08:40.841911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 756/1541] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:40 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:41.853041 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c2885993-74cd-478e-845e-a23de9e778bc tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe810a21f0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:41.886317 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c2885993-74cd-478e-845e-a23de9e778bc tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 200 len: 287 microversion: 2.1 time: 0.036901 Aug 04 14:08:41.886893 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 786/1542] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:41 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:42.898421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-fc7ac606-296a-47ac-ad09-72425f85d711 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c2ccee0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:42.927004 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-fc7ac606-296a-47ac-ad09-72425f85d711 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 200 len: 287 microversion: 2.1 time: 0.032314 Aug 04 14:08:42.927563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 757/1543] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:42 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:43.939351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-371818bb-a8ca-407f-aec2-59464c3f7623 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c4b39d0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:43.968906 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-371818bb-a8ca-407f-aec2-59464c3f7623 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 200 len: 288 microversion: 2.1 time: 0.033928 Aug 04 14:08:43.969460 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 787/1544] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:43 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:43.980869 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-003c7c77-1d1d-4dfe-942f-eb9153405a1e tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c2deaf0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:44.035420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-003c7c77-1d1d-4dfe-942f-eb9153405a1e tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 202 len: 0 microversion: 2.1 time: 0.058126 Aug 04 14:08:44.035985 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 758/1545] 10.222.0.43 () {58 vars in 1254 bytes} [Wed Aug 4 14:08:43 2021] DELETE /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:08:44.044261 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-0398b9b2-061d-44ec-ae12-fb8a2a7cc614 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe8108d5e0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:44.073791 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-0398b9b2-061d-44ec-ae12-fb8a2a7cc614 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 200 len: 287 microversion: 2.1 time: 0.033231 Aug 04 14:08:44.074362 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 788/1546] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:44 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:45.086671 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3d57fe6e-b764-49d3-b02d-b229de7a52bb tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c2deb80>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:45.110524 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-3d57fe6e-b764-49d3-b02d-b229de7a52bb tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] HTTP exception thrown: Snapshot 14b9a882-5ccc-4f20-96d3-1d015aba938b could not be found. Aug 04 14:08:45.111142 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3d57fe6e-b764-49d3-b02d-b229de7a52bb tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Returning 404 to user: Snapshot 14b9a882-5ccc-4f20-96d3-1d015aba938b could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:45.111953 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3d57fe6e-b764-49d3-b02d-b229de7a52bb tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b" status: 404 len: 111 microversion: 2.1 time: 0.029165 Aug 04 14:08:45.113162 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 759/1547] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:08:45 2021] GET /compute/v2.1/os-snapshots/14b9a882-5ccc-4f20-96d3-1d015aba938b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:45.121084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bcb6b4b6-02b1-4115-bc36-2fa5faccd127 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe810a29d0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:45.186052 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bcb6b4b6-02b1-4115-bc36-2fa5faccd127 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85" status: 202 len: 0 microversion: 2.1 time: 0.068555 Aug 04 14:08:45.186999 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 789/1548] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Aug 4 14:08:45 2021] DELETE /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:08:45.195764 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-7759c609-b958-407a-a65b-ec96d8f4d2c8 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c2ef4c0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:45.249790 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-7759c609-b958-407a-a65b-ec96d8f4d2c8 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85" status: 200 len: 344 microversion: 2.1 time: 0.057706 Aug 04 14:08:45.250363 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 760/1549] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:08:45 2021] GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:08:45.699184 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8e5641f1-fe2c-48ea-be00-7a4dae880d85 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:45.699675 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8e5641f1-fe2c-48ea-be00-7a4dae880d85 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:45.706380 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e5641f1-fe2c-48ea-be00-7a4dae880d85 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:45.706960 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e5641f1-fe2c-48ea-be00-7a4dae880d85 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:45.707618 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e5641f1-fe2c-48ea-be00-7a4dae880d85 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:45.708048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-8e5641f1-fe2c-48ea-be00-7a4dae880d85 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:45.735601 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-8e5641f1-fe2c-48ea-be00-7a4dae880d85 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Going to try to terminate instance {{(pid=107822) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:08:45.756977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-ac1defd3-ae10-4318-bab3-aa5a5d26c331 req-e894d6f9-ba30-4003-87c6-8aa66794ffcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f294abe-0e93-4c4a-a576-256d5711a5ec", "tag": "0d3ac144-6427-446d-ba0f-bfa1b99ceb8f"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:45.758432 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:08:45.758432 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:08:45.765528 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ac1defd3-ae10-4318-bab3-aa5a5d26c331 req-e894d6f9-ba30-4003-87c6-8aa66794ffcc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:45.766203 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-ac1defd3-ae10-4318-bab3-aa5a5d26c331 req-e894d6f9-ba30-4003-87c6-8aa66794ffcc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:45.778271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-ac1defd3-ae10-4318-bab3-aa5a5d26c331 req-e894d6f9-ba30-4003-87c6-8aa66794ffcc service nova] Creating event network-changed:0d3ac144-6427-446d-ba0f-bfa1b99ceb8f for instance 4f294abe-0e93-4c4a-a576-256d5711a5ec on hv-cinder-79264 Aug 04 14:08:45.783747 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-ac1defd3-ae10-4318-bab3-aa5a5d26c331 req-e894d6f9-ba30-4003-87c6-8aa66794ffcc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085343 Aug 04 14:08:45.785236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 761/1550] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:08:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:45.824382 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8e5641f1-fe2c-48ea-be00-7a4dae880d85 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 204 len: 0 microversion: 2.1 time: 0.128972 Aug 04 14:08:45.825318 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 790/1551] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:08:45 2021] DELETE /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:08:45.837138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e42df78a-4f06-4938-853e-83041455e178 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:45.837831 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e42df78a-4f06-4938-853e-83041455e178 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:45.844240 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e42df78a-4f06-4938-853e-83041455e178 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:45.844910 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e42df78a-4f06-4938-853e-83041455e178 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:45.845683 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e42df78a-4f06-4938-853e-83041455e178 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:45.846114 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e42df78a-4f06-4938-853e-83041455e178 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:45.981761 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e42df78a-4f06-4938-853e-83041455e178 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:45.993000 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e42df78a-4f06-4938-853e-83041455e178 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1578 microversion: 2.1 time: 0.160141 Aug 04 14:08:45.994257 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 762/1552] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:45 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:46.262726 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f9ca96c5-2f26-470f-abc7-ef219b5eac0a tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe810f0160>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:46.292662 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-f9ca96c5-2f26-470f-abc7-ef219b5eac0a tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] HTTP exception thrown: Volume 57e4044c-f4cc-428f-8526-10d4cc5dcc85 could not be found. Aug 04 14:08:46.293259 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-f9ca96c5-2f26-470f-abc7-ef219b5eac0a tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Returning 404 to user: Volume 57e4044c-f4cc-428f-8526-10d4cc5dcc85 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:46.294088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-f9ca96c5-2f26-470f-abc7-ef219b5eac0a tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85" status: 404 len: 109 microversion: 2.1 time: 0.035549 Aug 04 14:08:46.294778 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 791/1553] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:08:46 2021] GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:46.308766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3561ae05-6de3-4854-86c8-0879aa15de10 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c2cc280>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:46.338357 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-3561ae05-6de3-4854-86c8-0879aa15de10 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] HTTP exception thrown: Volume 57e4044c-f4cc-428f-8526-10d4cc5dcc85 could not be found. Aug 04 14:08:46.338955 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3561ae05-6de3-4854-86c8-0879aa15de10 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Returning 404 to user: Volume 57e4044c-f4cc-428f-8526-10d4cc5dcc85 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:46.339783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3561ae05-6de3-4854-86c8-0879aa15de10 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85" status: 404 len: 109 microversion: 2.1 time: 0.034724 Aug 04 14:08:46.340503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 763/1554] 10.222.0.43 () {58 vars in 1248 bytes} [Wed Aug 4 14:08:46 2021] DELETE /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:46.350562 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2aae49eb-1738-4706-a83c-f614b85f3f70 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Calling method '.version_select at 0x7efe7c4b3a60>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:46.378831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-2aae49eb-1738-4706-a83c-f614b85f3f70 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] HTTP exception thrown: Volume 57e4044c-f4cc-428f-8526-10d4cc5dcc85 could not be found. Aug 04 14:08:46.379633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2aae49eb-1738-4706-a83c-f614b85f3f70 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] Returning 404 to user: Volume 57e4044c-f4cc-428f-8526-10d4cc5dcc85 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:46.380654 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2aae49eb-1738-4706-a83c-f614b85f3f70 tempest-VolumesSnapshotsTestJSON-1253652640 tempest-VolumesSnapshotsTestJSON-1253652640-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85" status: 404 len: 109 microversion: 2.1 time: 0.036201 Aug 04 14:08:46.381628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 792/1555] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:08:46 2021] GET /compute/v2.1/os-volumes/57e4044c-f4cc-428f-8526-10d4cc5dcc85 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:47.014681 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ff664b3d-63da-4f73-ab32-30c2839112de tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:47.015334 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ff664b3d-63da-4f73-ab32-30c2839112de tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:47.022519 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff664b3d-63da-4f73-ab32-30c2839112de tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:47.022946 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff664b3d-63da-4f73-ab32-30c2839112de tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:47.023728 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff664b3d-63da-4f73-ab32-30c2839112de tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:47.024258 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff664b3d-63da-4f73-ab32-30c2839112de tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:47.157299 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ff664b3d-63da-4f73-ab32-30c2839112de tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:47.164766 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ff664b3d-63da-4f73-ab32-30c2839112de tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1459 microversion: 2.1 time: 0.153759 Aug 04 14:08:47.165335 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 764/1556] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:47 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1459 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:48.182112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9a8007f8-f2a3-4af6-b36a-33deaec47833 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:48.182889 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9a8007f8-f2a3-4af6-b36a-33deaec47833 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:48.188927 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a8007f8-f2a3-4af6-b36a-33deaec47833 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:48.189694 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a8007f8-f2a3-4af6-b36a-33deaec47833 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:48.191380 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a8007f8-f2a3-4af6-b36a-33deaec47833 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:48.192117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9a8007f8-f2a3-4af6-b36a-33deaec47833 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:48.327264 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9a8007f8-f2a3-4af6-b36a-33deaec47833 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:48.335673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9a8007f8-f2a3-4af6-b36a-33deaec47833 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1459 microversion: 2.1 time: 0.157249 Aug 04 14:08:48.336568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 793/1557] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:48 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:48.608464 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-72f1fc7a-de73-4403-9a37-ae663b615a78 req-0a302980-e0e4-4a43-bdb5-a4d7a67f4d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f294abe-0e93-4c4a-a576-256d5711a5ec", "name": "network-vif-deleted", "tag": "0d3ac144-6427-446d-ba0f-bfa1b99ceb8f"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:48.611076 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:08:48.611076 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:08:48.619511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-72f1fc7a-de73-4403-9a37-ae663b615a78 req-0a302980-e0e4-4a43-bdb5-a4d7a67f4d97 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:48.619511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-72f1fc7a-de73-4403-9a37-ae663b615a78 req-0a302980-e0e4-4a43-bdb5-a4d7a67f4d97 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:48.631670 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-72f1fc7a-de73-4403-9a37-ae663b615a78 req-0a302980-e0e4-4a43-bdb5-a4d7a67f4d97 service nova] Creating event network-vif-deleted:0d3ac144-6427-446d-ba0f-bfa1b99ceb8f for instance 4f294abe-0e93-4c4a-a576-256d5711a5ec on hv-cinder-79264 Aug 04 14:08:48.643532 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-72f1fc7a-de73-4403-9a37-ae663b615a78 req-0a302980-e0e4-4a43-bdb5-a4d7a67f4d97 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038866 Aug 04 14:08:48.644867 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 765/1558] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:49.352658 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:49.353433 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:49.359276 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:49.359733 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:49.360628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:49.361064 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:49.395453 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:49.395894 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:49.396382 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lazy-loading 'fault' on Instance uuid 4f294abe-0e93-4c4a-a576-256d5711a5ec {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:08:49.437039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:49.445912 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9b493bdc-f189-441d-a3bc-bbccfbc05b1f tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 200 len: 1230 microversion: 2.1 time: 0.096833 Aug 04 14:08:49.446747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 794/1559] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:49 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:08:50.464157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:50.464861 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: 4f294abe-0e93-4c4a-a576-256d5711a5ec] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:50.470898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:50.471335 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:50.472159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:50.473364 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:50.489638 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] HTTP exception thrown: Instance 4f294abe-0e93-4c4a-a576-256d5711a5ec could not be found. Aug 04 14:08:50.490223 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Returning 404 to user: Instance 4f294abe-0e93-4c4a-a576-256d5711a5ec could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:08:50.491048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a8924202-a899-4aea-9d36-3917a2f24266 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec" status: 404 len: 111 microversion: 2.1 time: 0.031192 Aug 04 14:08:50.491582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 766/1560] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:50 2021] GET /compute/v2.1/servers/4f294abe-0e93-4c4a-a576-256d5711a5ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:58.746283 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-30ac98e7-d36d-4fcd-bb43-32ab72628f22 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:58.746796 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-30ac98e7-d36d-4fcd-bb43-32ab72628f22 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:58.748680 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-6ca1cece-3679-4d71-816f-86f60aa4ed7f req-f6594b17-d024-4d9c-ba6c-73a2e73a6e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d", "tag": "27e8d73b-a91d-45f1-8a1a-300b0d34f699"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:58.750445 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:08:58.750445 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:08:58.752609 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-30ac98e7-d36d-4fcd-bb43-32ab72628f22 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:58.753313 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-30ac98e7-d36d-4fcd-bb43-32ab72628f22 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:58.754342 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-30ac98e7-d36d-4fcd-bb43-32ab72628f22 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:58.755274 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-30ac98e7-d36d-4fcd-bb43-32ab72628f22 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:58.757737 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-6ca1cece-3679-4d71-816f-86f60aa4ed7f req-f6594b17-d024-4d9c-ba6c-73a2e73a6e46 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:58.758180 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-6ca1cece-3679-4d71-816f-86f60aa4ed7f req-f6594b17-d024-4d9c-ba6c-73a2e73a6e46 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:58.769104 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-6ca1cece-3679-4d71-816f-86f60aa4ed7f req-f6594b17-d024-4d9c-ba6c-73a2e73a6e46 service nova] Creating event network-changed:27e8d73b-a91d-45f1-8a1a-300b0d34f699 for instance cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d on hv-cinder-79264 Aug 04 14:08:58.774698 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-6ca1cece-3679-4d71-816f-86f60aa4ed7f req-f6594b17-d024-4d9c-ba6c-73a2e73a6e46 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029929 Aug 04 14:08:58.775539 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 767/1561] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:08:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:58.782770 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-30ac98e7-d36d-4fcd-bb43-32ab72628f22 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Going to try to terminate instance {{(pid=107822) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:08:58.868543 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-30ac98e7-d36d-4fcd-bb43-32ab72628f22 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 204 len: 0 microversion: 2.1 time: 0.125724 Aug 04 14:08:58.870344 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 795/1562] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:08:58 2021] DELETE /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:08:58.884865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2769f54f-aabb-4b67-b90e-eb40e11e3785 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:58.886144 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2769f54f-aabb-4b67-b90e-eb40e11e3785 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:08:58.897694 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2769f54f-aabb-4b67-b90e-eb40e11e3785 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:58.898492 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2769f54f-aabb-4b67-b90e-eb40e11e3785 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:58.900138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2769f54f-aabb-4b67-b90e-eb40e11e3785 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:08:58.901100 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2769f54f-aabb-4b67-b90e-eb40e11e3785 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:08:59.194535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2769f54f-aabb-4b67-b90e-eb40e11e3785 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:59.202497 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2769f54f-aabb-4b67-b90e-eb40e11e3785 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1580 microversion: 2.1 time: 0.325979 Aug 04 14:08:59.203068 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 768/1563] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:08:58 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1580 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:00.220760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-521eb96e-ae41-4c87-81a2-7e0d20ac6954 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:00.221448 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-521eb96e-ae41-4c87-81a2-7e0d20ac6954 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:00.227992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-521eb96e-ae41-4c87-81a2-7e0d20ac6954 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:00.228480 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-521eb96e-ae41-4c87-81a2-7e0d20ac6954 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:00.229245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-521eb96e-ae41-4c87-81a2-7e0d20ac6954 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:00.229672 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-521eb96e-ae41-4c87-81a2-7e0d20ac6954 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:00.354865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-521eb96e-ae41-4c87-81a2-7e0d20ac6954 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829a37a970b04d14a0b13b5d54ae2f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5ccb2cd26145b7bcd0a36e172762d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:00.366461 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-521eb96e-ae41-4c87-81a2-7e0d20ac6954 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 200 len: 1461 microversion: 2.1 time: 0.149534 Aug 04 14:09:00.375784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 796/1564] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:00 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 1461 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:00.408520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-e3bc919a-d1eb-4e66-b728-5a3e52a667c6 req-f9d4a328-25fc-4d85-9ae4-a03cfe6bd515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d", "name": "network-vif-deleted", "tag": "27e8d73b-a91d-45f1-8a1a-300b0d34f699"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:00.410156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:09:00.410156 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:09:00.417949 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-e3bc919a-d1eb-4e66-b728-5a3e52a667c6 req-f9d4a328-25fc-4d85-9ae4-a03cfe6bd515 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:00.418286 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-e3bc919a-d1eb-4e66-b728-5a3e52a667c6 req-f9d4a328-25fc-4d85-9ae4-a03cfe6bd515 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:00.429018 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-e3bc919a-d1eb-4e66-b728-5a3e52a667c6 req-f9d4a328-25fc-4d85-9ae4-a03cfe6bd515 service nova] Creating event network-vif-deleted:27e8d73b-a91d-45f1-8a1a-300b0d34f699 for instance cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d on hv-cinder-79264 Aug 04 14:09:00.433877 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-e3bc919a-d1eb-4e66-b728-5a3e52a667c6 req-f9d4a328-25fc-4d85-9ae4-a03cfe6bd515 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029139 Aug 04 14:09:00.434582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 769/1565] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:09:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:01.383445 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:01.384051 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:01.390321 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:01.390771 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:01.391547 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:01.391978 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:01.405650 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] HTTP exception thrown: Instance cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d could not be found. Aug 04 14:09:01.406223 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Returning 404 to user: Instance cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:01.407035 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6d1444e0-cdb4-4540-b271-737a67e4efe6 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d" status: 404 len: 111 microversion: 2.1 time: 0.027444 Aug 04 14:09:01.407632 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 797/1566] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:01 2021] GET /compute/v2.1/servers/cfabb7a9-b5f1-4462-9c06-ed375e0b5d0d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:01.875765 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:01.876372 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:01.883377 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:01.883825 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:01.884642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:01.885067 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:01.898596 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] HTTP exception thrown: Instance f674980e-9f84-4659-bbd4-114786775944 could not be found. Aug 04 14:09:01.899362 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Returning 404 to user: Instance f674980e-9f84-4659-bbd4-114786775944 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:01.900289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-28279618-f56b-4a84-a0c1-a3e14cb45f24 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 404 len: 111 microversion: 2.1 time: 0.028500 Aug 04 14:09:01.900845 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 770/1567] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:09:01 2021] DELETE /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:01.909065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:01.909720 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] [instance: f674980e-9f84-4659-bbd4-114786775944] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:01.915873 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:01.916352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:01.917112 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:01.917540 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:01.933935 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] HTTP exception thrown: Instance f674980e-9f84-4659-bbd4-114786775944 could not be found. Aug 04 14:09:01.934530 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Returning 404 to user: Instance f674980e-9f84-4659-bbd4-114786775944 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:01.935355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7a424ca7-9570-405c-a0c7-820eaaed490d tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944" status: 404 len: 111 microversion: 2.1 time: 0.030311 Aug 04 14:09:01.936065 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 798/1568] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:01 2021] GET /compute/v2.1/servers/f674980e-9f84-4659-bbd4-114786775944 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:03.252092 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-736f935e-389f-4521-aadf-efd226f19772 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] Calling method '.version_select at 0x7efe7c30fee0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:03.277122 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-736f935e-389f-4521-aadf-efd226f19772 tempest-TestVolumeBootPattern-1764025992 tempest-TestVolumeBootPattern-1764025992-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1866386038" status: 202 len: 0 microversion: 2.1 time: 0.028591 Aug 04 14:09:03.281093 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 771/1569] 10.222.0.43 () {58 vars in 1263 bytes} [Wed Aug 4 14:09:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1866386038 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:09:24.012743 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1302862360", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "4a9bfe9b-d837-4200-a7e1-9f3693bc400b"}]}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:24.066888 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] validate_networks() for [('4a9bfe9b-d837-4200-a7e1-9f3693bc400b', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:09:24.460128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:09:24.460578 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:09:24.461048 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:09:24.461510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:09:24.461930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:09:24.470853 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:24.471305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:24.472092 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:24.472556 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:24.641815 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Getting quotas for project 1b932d0ef1914db09ea397e5e2b19a0c. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:09:24.645619 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Getting quotas for user e46264c746204ed7a219299c43fef604 and project 1b932d0ef1914db09ea397e5e2b19a0c. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:09:24.656628 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:09:24.658926 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:09:24.703564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-61b2a7cc-0f4b-4c29-a5dc-1188d4e8bdff tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694451 Aug 04 14:09:24.704229 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 799/1570] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:09:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:09:24.716019 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d707d756-bd42-452f-8904-dc75a5ae13a8 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:24.716588 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d707d756-bd42-452f-8904-dc75a5ae13a8 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:24.772535 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d707d756-bd42-452f-8904-dc75a5ae13a8 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:24.779890 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d707d756-bd42-452f-8904-dc75a5ae13a8 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1214 microversion: 2.1 time: 0.068742 Aug 04 14:09:24.780568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 772/1571] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:24 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:25.796588 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2e941b5e-ead5-4047-b1aa-a546fbabb376 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:25.797192 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2e941b5e-ead5-4047-b1aa-a546fbabb376 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:25.803673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e941b5e-ead5-4047-b1aa-a546fbabb376 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:25.804106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e941b5e-ead5-4047-b1aa-a546fbabb376 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:25.804884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e941b5e-ead5-4047-b1aa-a546fbabb376 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:25.805360 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2e941b5e-ead5-4047-b1aa-a546fbabb376 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:25.867814 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2e941b5e-ead5-4047-b1aa-a546fbabb376 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:25.875089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2e941b5e-ead5-4047-b1aa-a546fbabb376 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1272 microversion: 2.1 time: 0.082339 Aug 04 14:09:25.875648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 800/1572] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:25 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:26.892138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-febee474-b24c-46eb-aa10-fbbe27f87d10 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:26.892773 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-febee474-b24c-46eb-aa10-fbbe27f87d10 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:26.898470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-febee474-b24c-46eb-aa10-fbbe27f87d10 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:26.898917 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-febee474-b24c-46eb-aa10-fbbe27f87d10 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:26.899682 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-febee474-b24c-46eb-aa10-fbbe27f87d10 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:26.900105 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-febee474-b24c-46eb-aa10-fbbe27f87d10 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:27.016554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-e63e2cc7-3c43-4811-9189-f07daadf8054 req-46bce55a-43d5-41c6-83b0-38124efad587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67eea712-e164-47e9-a4e5-914856b99a6b", "tag": "0cb4fad6-3255-4846-a749-3ee3f5a49eff"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:27.018351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:09:27.018351 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:09:27.026925 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-e63e2cc7-3c43-4811-9189-f07daadf8054 req-46bce55a-43d5-41c6-83b0-38124efad587 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:27.027369 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-e63e2cc7-3c43-4811-9189-f07daadf8054 req-46bce55a-43d5-41c6-83b0-38124efad587 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:27.039768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-e63e2cc7-3c43-4811-9189-f07daadf8054 req-46bce55a-43d5-41c6-83b0-38124efad587 service nova] Creating event network-changed:0cb4fad6-3255-4846-a749-3ee3f5a49eff for instance 67eea712-e164-47e9-a4e5-914856b99a6b on hv-cinder-79264 Aug 04 14:09:27.044943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-e63e2cc7-3c43-4811-9189-f07daadf8054 req-46bce55a-43d5-41c6-83b0-38124efad587 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032193 Aug 04 14:09:27.045775 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 801/1573] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:09:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:09:27.105776 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-febee474-b24c-46eb-aa10-fbbe27f87d10 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:27.113044 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-febee474-b24c-46eb-aa10-fbbe27f87d10 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1314 microversion: 2.1 time: 0.224520 Aug 04 14:09:27.113650 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 773/1574] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:26 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:28.129947 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1caa85bd-b11f-4b92-a029-9d75a22a638c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:28.131134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1caa85bd-b11f-4b92-a029-9d75a22a638c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:28.138103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1caa85bd-b11f-4b92-a029-9d75a22a638c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:28.138544 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1caa85bd-b11f-4b92-a029-9d75a22a638c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:28.139319 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1caa85bd-b11f-4b92-a029-9d75a22a638c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:28.139753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1caa85bd-b11f-4b92-a029-9d75a22a638c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:28.266287 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1caa85bd-b11f-4b92-a029-9d75a22a638c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:28.273506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1caa85bd-b11f-4b92-a029-9d75a22a638c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1314 microversion: 2.1 time: 0.147662 Aug 04 14:09:28.274062 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 802/1575] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:28 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:29.290620 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6f80d297-c516-4e77-ad50-b95799b3b51c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:29.291232 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6f80d297-c516-4e77-ad50-b95799b3b51c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:29.297027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6f80d297-c516-4e77-ad50-b95799b3b51c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:29.297471 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6f80d297-c516-4e77-ad50-b95799b3b51c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:29.298238 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6f80d297-c516-4e77-ad50-b95799b3b51c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:29.298667 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6f80d297-c516-4e77-ad50-b95799b3b51c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:29.423214 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6f80d297-c516-4e77-ad50-b95799b3b51c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:29.430966 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6f80d297-c516-4e77-ad50-b95799b3b51c tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1314 microversion: 2.1 time: 0.144577 Aug 04 14:09:29.431525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 774/1576] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:29 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:30.451477 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7c22c5ce-7059-4ed3-9c85-e5925b6976ba tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:30.452378 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7c22c5ce-7059-4ed3-9c85-e5925b6976ba tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:30.458320 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c22c5ce-7059-4ed3-9c85-e5925b6976ba tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:30.458768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c22c5ce-7059-4ed3-9c85-e5925b6976ba tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:30.460326 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c22c5ce-7059-4ed3-9c85-e5925b6976ba tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:30.460768 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7c22c5ce-7059-4ed3-9c85-e5925b6976ba tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:30.595871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7c22c5ce-7059-4ed3-9c85-e5925b6976ba tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:30.603134 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7c22c5ce-7059-4ed3-9c85-e5925b6976ba tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1314 microversion: 2.1 time: 0.160180 Aug 04 14:09:30.603690 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 803/1577] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:30 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:31.619734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ef07c1c9-72b5-4c53-b917-059467dd73f4 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:31.620378 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ef07c1c9-72b5-4c53-b917-059467dd73f4 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:31.626477 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef07c1c9-72b5-4c53-b917-059467dd73f4 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:31.626928 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef07c1c9-72b5-4c53-b917-059467dd73f4 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:31.627700 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef07c1c9-72b5-4c53-b917-059467dd73f4 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:31.628134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ef07c1c9-72b5-4c53-b917-059467dd73f4 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:31.747956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ef07c1c9-72b5-4c53-b917-059467dd73f4 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:31.755161 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ef07c1c9-72b5-4c53-b917-059467dd73f4 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1314 microversion: 2.1 time: 0.139127 Aug 04 14:09:31.755731 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 775/1578] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:31 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:32.772838 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-42785326-e026-42ab-b1c9-1270f26b449a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:32.773407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-42785326-e026-42ab-b1c9-1270f26b449a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:32.779260 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42785326-e026-42ab-b1c9-1270f26b449a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:32.779707 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42785326-e026-42ab-b1c9-1270f26b449a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:32.780505 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42785326-e026-42ab-b1c9-1270f26b449a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:32.780943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-42785326-e026-42ab-b1c9-1270f26b449a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:32.900693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-42785326-e026-42ab-b1c9-1270f26b449a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:32.907760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-42785326-e026-42ab-b1c9-1270f26b449a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1314 microversion: 2.1 time: 0.139251 Aug 04 14:09:32.908332 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 804/1579] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:32 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:33.319097 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-0fd0d653-4947-427a-8845-cd4a4bc835dd req-4ea74c8a-db84-460d-be4c-2df0c7b0afd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67eea712-e164-47e9-a4e5-914856b99a6b", "name": "network-vif-plugged", "status": "completed", "tag": "0cb4fad6-3255-4846-a749-3ee3f5a49eff"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:33.320737 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:09:33.320737 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:09:33.327931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-0fd0d653-4947-427a-8845-cd4a4bc835dd req-4ea74c8a-db84-460d-be4c-2df0c7b0afd6 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:33.328411 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-0fd0d653-4947-427a-8845-cd4a4bc835dd req-4ea74c8a-db84-460d-be4c-2df0c7b0afd6 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:33.340662 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-0fd0d653-4947-427a-8845-cd4a4bc835dd req-4ea74c8a-db84-460d-be4c-2df0c7b0afd6 service nova] Creating event network-vif-plugged:0cb4fad6-3255-4846-a749-3ee3f5a49eff for instance 67eea712-e164-47e9-a4e5-914856b99a6b on hv-cinder-79264 Aug 04 14:09:33.345470 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-0fd0d653-4947-427a-8845-cd4a4bc835dd req-4ea74c8a-db84-460d-be4c-2df0c7b0afd6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030211 Aug 04 14:09:33.346061 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 776/1580] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:33.924988 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-be2d09fd-2499-4d62-9a77-ae86b9db8475 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:33.925516 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-be2d09fd-2499-4d62-9a77-ae86b9db8475 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:33.931643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-be2d09fd-2499-4d62-9a77-ae86b9db8475 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:33.932084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-be2d09fd-2499-4d62-9a77-ae86b9db8475 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:33.932890 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-be2d09fd-2499-4d62-9a77-ae86b9db8475 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:33.933320 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-be2d09fd-2499-4d62-9a77-ae86b9db8475 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:34.059661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-be2d09fd-2499-4d62-9a77-ae86b9db8475 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:34.066786 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-be2d09fd-2499-4d62-9a77-ae86b9db8475 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1314 microversion: 2.1 time: 0.145658 Aug 04 14:09:34.067338 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 805/1581] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:33 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:35.084533 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-191f02b9-3f37-42ef-a31f-59c0201d1c0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:35.085223 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-191f02b9-3f37-42ef-a31f-59c0201d1c0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:35.091206 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-191f02b9-3f37-42ef-a31f-59c0201d1c0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:35.091651 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-191f02b9-3f37-42ef-a31f-59c0201d1c0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:35.092479 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-191f02b9-3f37-42ef-a31f-59c0201d1c0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:35.092909 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-191f02b9-3f37-42ef-a31f-59c0201d1c0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:35.217019 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-191f02b9-3f37-42ef-a31f-59c0201d1c0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:35.224154 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-191f02b9-3f37-42ef-a31f-59c0201d1c0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1498 microversion: 2.1 time: 0.143812 Aug 04 14:09:35.225302 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 777/1582] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:35 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:35.718954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-771813a4-e808-4445-9306-a2bb8ac1fd0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:35.719454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-771813a4-e808-4445-9306-a2bb8ac1fd0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:35.725764 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-771813a4-e808-4445-9306-a2bb8ac1fd0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:35.726208 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-771813a4-e808-4445-9306-a2bb8ac1fd0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:35.726967 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-771813a4-e808-4445-9306-a2bb8ac1fd0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:35.727395 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-771813a4-e808-4445-9306-a2bb8ac1fd0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:35.751481 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-771813a4-e808-4445-9306-a2bb8ac1fd0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Going to try to terminate instance {{(pid=107822) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:09:35.824966 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-771813a4-e808-4445-9306-a2bb8ac1fd0d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "DELETE /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 204 len: 0 microversion: 2.1 time: 0.109239 Aug 04 14:09:35.825583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 806/1583] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:09:35 2021] DELETE /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:35.834095 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-88a1ecd3-b2f7-44c1-aec0-543e2e3b88fe tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:35.834889 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-88a1ecd3-b2f7-44c1-aec0-543e2e3b88fe tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:35.840654 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-88a1ecd3-b2f7-44c1-aec0-543e2e3b88fe tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:35.841099 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-88a1ecd3-b2f7-44c1-aec0-543e2e3b88fe tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:35.841862 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-88a1ecd3-b2f7-44c1-aec0-543e2e3b88fe tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:35.842290 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-88a1ecd3-b2f7-44c1-aec0-543e2e3b88fe tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:35.965560 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-88a1ecd3-b2f7-44c1-aec0-543e2e3b88fe tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:35.972715 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-88a1ecd3-b2f7-44c1-aec0-543e2e3b88fe tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1504 microversion: 2.1 time: 0.142412 Aug 04 14:09:35.973289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 778/1584] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:35 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1504 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:36.991799 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a81a0f77-8a89-45bc-8422-9ff7a0738054 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:36.992541 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a81a0f77-8a89-45bc-8422-9ff7a0738054 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:36.998335 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a81a0f77-8a89-45bc-8422-9ff7a0738054 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:36.998774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a81a0f77-8a89-45bc-8422-9ff7a0738054 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:36.999530 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a81a0f77-8a89-45bc-8422-9ff7a0738054 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:36.999957 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a81a0f77-8a89-45bc-8422-9ff7a0738054 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:37.121881 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a81a0f77-8a89-45bc-8422-9ff7a0738054 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:37.129033 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a81a0f77-8a89-45bc-8422-9ff7a0738054 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1504 microversion: 2.1 time: 0.142272 Aug 04 14:09:37.129586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 807/1585] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:36 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1504 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:37.364934 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-96b88d84-4990-4d65-a711-e6cdbbce8ed4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:37.366210 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-96b88d84-4990-4d65-a711-e6cdbbce8ed4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:37.371916 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-96b88d84-4990-4d65-a711-e6cdbbce8ed4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:37.372407 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-96b88d84-4990-4d65-a711-e6cdbbce8ed4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:37.373182 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-96b88d84-4990-4d65-a711-e6cdbbce8ed4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:37.373617 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-96b88d84-4990-4d65-a711-e6cdbbce8ed4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:37.399361 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-96b88d84-4990-4d65-a711-e6cdbbce8ed4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:09:37.473843 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-96b88d84-4990-4d65-a711-e6cdbbce8ed4 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "DELETE /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 204 len: 0 microversion: 2.20 time: 0.112283 Aug 04 14:09:37.475485 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 779/1586] 10.222.0.43 () {60 vars in 1280 bytes} [Wed Aug 4 14:09:37 2021] DELETE /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:09:37.483528 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:37.484139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:37.489954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:37.491043 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:37.491909 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:37.492408 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:37.612938 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:37.620744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:37.622252 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:37.623397 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-463c79b2-4dae-47a8-b03b-6e39ffaf9a87 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.143617 Aug 04 14:09:37.623943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 808/1587] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:09:37 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:09:38.126652 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-f9673429-3089-4e29-b3c7-3aca78071d6e req-8a676dad-308a-4e05-88db-48404b7548bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67eea712-e164-47e9-a4e5-914856b99a6b", "name": "network-vif-deleted", "tag": "0cb4fad6-3255-4846-a749-3ee3f5a49eff"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:38.128136 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:09:38.128136 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:09:38.135988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-f9673429-3089-4e29-b3c7-3aca78071d6e req-8a676dad-308a-4e05-88db-48404b7548bc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:38.136523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-f9673429-3089-4e29-b3c7-3aca78071d6e req-8a676dad-308a-4e05-88db-48404b7548bc service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:38.148863 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-80c1e7ba-4c99-46af-9390-7415f525580b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:38.150305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-80c1e7ba-4c99-46af-9390-7415f525580b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:38.156896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-80c1e7ba-4c99-46af-9390-7415f525580b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:38.157348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-80c1e7ba-4c99-46af-9390-7415f525580b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:38.158127 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-80c1e7ba-4c99-46af-9390-7415f525580b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:38.158558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-80c1e7ba-4c99-46af-9390-7415f525580b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:38.159647 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-f9673429-3089-4e29-b3c7-3aca78071d6e req-8a676dad-308a-4e05-88db-48404b7548bc service nova] Creating event network-vif-deleted:0cb4fad6-3255-4846-a749-3ee3f5a49eff for instance 67eea712-e164-47e9-a4e5-914856b99a6b on hv-cinder-79264 Aug 04 14:09:38.164569 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-f9673429-3089-4e29-b3c7-3aca78071d6e req-8a676dad-308a-4e05-88db-48404b7548bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042673 Aug 04 14:09:38.165404 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 780/1588] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:38.224739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-80c1e7ba-4c99-46af-9390-7415f525580b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:38.232060 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-80c1e7ba-4c99-46af-9390-7415f525580b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 200 len: 1299 microversion: 2.1 time: 0.087566 Aug 04 14:09:38.232648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 809/1589] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:38 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:09:38.642134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:38.642826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:38.649202 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:38.649653 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:38.650462 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:38.650875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:38.774994 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:38.782816 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:38.784311 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:38.785430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2cc493c6-4d69-4072-be9e-645cc7dfb178 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.147470 Aug 04 14:09:38.785992 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 781/1590] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:09:38 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:09:39.248992 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:39.249605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 67eea712-e164-47e9-a4e5-914856b99a6b] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:39.255358 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:39.255831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:39.256943 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:39.257368 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:39.272510 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] HTTP exception thrown: Instance 67eea712-e164-47e9-a4e5-914856b99a6b could not be found. Aug 04 14:09:39.273035 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Returning 404 to user: Instance 67eea712-e164-47e9-a4e5-914856b99a6b could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:39.274082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6442071a-a2b4-4551-b84f-3590818949b5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b" status: 404 len: 111 microversion: 2.1 time: 0.028799 Aug 04 14:09:39.274629 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 810/1591] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:39 2021] GET /compute/v2.1/servers/67eea712-e164-47e9-a4e5-914856b99a6b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:39.320437 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1135151637", "imageRef": "d2811aea-bb00-4abc-8047-831337c685a0", "flavorRef": "452", "networks": [{"uuid": "4a9bfe9b-d837-4200-a7e1-9f3693bc400b"}]}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:39.374928 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.network.neutron [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] validate_networks() for [('4a9bfe9b-d837-4200-a7e1-9f3693bc400b', None, None, None)] {{(pid=107823) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:09:39.805247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:39.805855 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:39.811449 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:39.811885 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:39.812684 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:39.813109 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:39.905246 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Flavor limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:09:39.906536 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Image limits 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:09:39.907079 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Flavor pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:09:39.907562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Image pref 0:0:0 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:09:39.908071 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.virt.hardware [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:09:39.917758 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:39.918261 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:39.919286 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:39.919854 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:39.940611 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Getting quotas for project 1b932d0ef1914db09ea397e5e2b19a0c. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:09:39.943515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:39.944431 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Getting quotas for user e46264c746204ed7a219299c43fef604 and project 1b932d0ef1914db09ea397e5e2b19a0c. Resources: {'cores', 'instances', 'ram'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:09:39.953729 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:39.955706 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Going to run 1 instances... {{(pid=107823) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:09:39.956343 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:39.958063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2811aea-bb00-4abc-8047-831337c685a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:09:39.958494 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-fd67f718-04fe-4d59-a6e7-5f7563b67ecd tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1725 microversion: 2.20 time: 0.157041 Aug 04 14:09:39.961801 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 811/1592] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:09:39 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:09:40.007107 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-25c6dbb2-5099-46ba-8353-7e65ac44db01 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690606 Aug 04 14:09:40.008495 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 782/1593] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:09:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:09:40.019525 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ca56dc44-1f31-440c-9283-890a3be6b71a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:40.020824 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ca56dc44-1f31-440c-9283-890a3be6b71a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:40.087118 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ca56dc44-1f31-440c-9283-890a3be6b71a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:40.094025 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ca56dc44-1f31-440c-9283-890a3be6b71a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1214 microversion: 2.1 time: 0.079715 Aug 04 14:09:40.104569 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 812/1594] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:40 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:40.790722 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-6c399f7c-93f6-462c-8c34-35e3b30b8500 req-a22560a0-ac82-4fc6-9d57-8245a7018432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71864169-d3ea-45e4-8e11-0a36283b817c", "name": "network-vif-deleted", "tag": "83351cb5-e13b-4211-b517-59a303fca918"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:40.792393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:09:40.792393 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:09:40.800668 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-6c399f7c-93f6-462c-8c34-35e3b30b8500 req-a22560a0-ac82-4fc6-9d57-8245a7018432 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:40.801115 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-6c399f7c-93f6-462c-8c34-35e3b30b8500 req-a22560a0-ac82-4fc6-9d57-8245a7018432 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:40.813035 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-6c399f7c-93f6-462c-8c34-35e3b30b8500 req-a22560a0-ac82-4fc6-9d57-8245a7018432 service nova] Creating event network-vif-deleted:83351cb5-e13b-4211-b517-59a303fca918 for instance 71864169-d3ea-45e4-8e11-0a36283b817c on hv-cinder-79264 Aug 04 14:09:40.818500 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-6c399f7c-93f6-462c-8c34-35e3b30b8500 req-a22560a0-ac82-4fc6-9d57-8245a7018432 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031762 Aug 04 14:09:40.819529 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 783/1595] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:09:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:40.978983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:40.979613 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:40.985766 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:40.986615 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:40.987421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:40.987923 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:41.030589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:41.031151 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:41.031503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.objects.instance [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lazy-loading 'fault' on Instance uuid 71864169-d3ea-45e4-8e11-0a36283b817c {{(pid=107822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:09:41.073273 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:41.082845 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:41.085574 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034d5f53aa544eb88d4522dea7b428ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072954af44a647e3a037f30f2ac7f27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:41.086980 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-06cf158b-63b3-4b2c-996a-1e9cfaa6cd92 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 200 len: 1372 microversion: 2.20 time: 0.112056 Aug 04 14:09:41.087861 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 813/1596] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:09:40 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:09:41.112210 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-274c6399-3988-45bd-af33-e198605ee4c9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:41.112834 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-274c6399-3988-45bd-af33-e198605ee4c9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:41.121266 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-274c6399-3988-45bd-af33-e198605ee4c9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:41.122600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-274c6399-3988-45bd-af33-e198605ee4c9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:41.123670 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-274c6399-3988-45bd-af33-e198605ee4c9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:41.125141 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-274c6399-3988-45bd-af33-e198605ee4c9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:41.204174 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-274c6399-3988-45bd-af33-e198605ee4c9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:41.213568 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-274c6399-3988-45bd-af33-e198605ee4c9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1284 microversion: 2.1 time: 0.105524 Aug 04 14:09:41.223816 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 784/1597] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:41 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:42.104693 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:42.105303 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:42.110973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:42.111417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:42.112182 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:42.112633 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:42.126109 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] HTTP exception thrown: Instance 71864169-d3ea-45e4-8e11-0a36283b817c could not be found. Aug 04 14:09:42.126698 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Returning 404 to user: Instance 71864169-d3ea-45e4-8e11-0a36283b817c could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:42.127520 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e2c3fab3-1fbe-440d-974a-67aaac287eb5 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 404 len: 111 microversion: 2.20 time: 0.026675 Aug 04 14:09:42.128064 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 814/1598] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Aug 4 14:09:42 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:09:42.136932 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-9c7c42b0-4337-48f8-80f7-e4c02725c5ba tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '.version_select at 0x7efe7c2deb80>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:42.155590 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-9c7c42b0-4337-48f8-80f7-e4c02725c5ba tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155402758" status: 204 len: 0 microversion: 2.20 time: 0.022205 Aug 04 14:09:42.156525 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 785/1599] 10.222.0.43 () {60 vars in 1262 bytes} [Wed Aug 4 14:09:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155402758 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 14:09:42.231755 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9fe015e9-0a05-49e8-b0c2-a894850274aa tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:42.232640 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9fe015e9-0a05-49e8-b0c2-a894850274aa tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:42.241919 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9fe015e9-0a05-49e8-b0c2-a894850274aa tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:42.242749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9fe015e9-0a05-49e8-b0c2-a894850274aa tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:42.244111 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9fe015e9-0a05-49e8-b0c2-a894850274aa tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:42.244884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9fe015e9-0a05-49e8-b0c2-a894850274aa tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:42.378458 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9fe015e9-0a05-49e8-b0c2-a894850274aa tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:42.385701 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9fe015e9-0a05-49e8-b0c2-a894850274aa tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1314 microversion: 2.1 time: 0.157721 Aug 04 14:09:42.386345 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 815/1600] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:42 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:42.842775 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-c8fa5ac2-9ac9-41e8-86c1-ae62d4b76ce0 req-d3d8156c-31c3-4bf5-848c-33b9b3679311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d60279-e34e-43e7-83d1-4c07482e7a82", "tag": "000d1613-bbc3-4ba7-9353-ae925bee885c"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:42.844691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:09:42.844691 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:09:42.853472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-c8fa5ac2-9ac9-41e8-86c1-ae62d4b76ce0 req-d3d8156c-31c3-4bf5-848c-33b9b3679311 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:42.854003 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-c8fa5ac2-9ac9-41e8-86c1-ae62d4b76ce0 req-d3d8156c-31c3-4bf5-848c-33b9b3679311 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:42.865669 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-c8fa5ac2-9ac9-41e8-86c1-ae62d4b76ce0 req-d3d8156c-31c3-4bf5-848c-33b9b3679311 service nova] Creating event network-changed:000d1613-bbc3-4ba7-9353-ae925bee885c for instance 84d60279-e34e-43e7-83d1-4c07482e7a82 on hv-cinder-79264 Aug 04 14:09:42.870836 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-c8fa5ac2-9ac9-41e8-86c1-ae62d4b76ce0 req-d3d8156c-31c3-4bf5-848c-33b9b3679311 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031798 Aug 04 14:09:42.871673 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 786/1601] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:09:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:09:43.402898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-593a5c1e-4c25-4652-9d75-fd9098038487 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:43.403747 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-593a5c1e-4c25-4652-9d75-fd9098038487 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:43.410696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-593a5c1e-4c25-4652-9d75-fd9098038487 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:43.411401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-593a5c1e-4c25-4652-9d75-fd9098038487 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:43.412905 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-593a5c1e-4c25-4652-9d75-fd9098038487 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:43.413442 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-593a5c1e-4c25-4652-9d75-fd9098038487 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:43.541676 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-593a5c1e-4c25-4652-9d75-fd9098038487 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:43.549916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-593a5c1e-4c25-4652-9d75-fd9098038487 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1314 microversion: 2.1 time: 0.150677 Aug 04 14:09:43.553371 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 816/1602] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:43 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:44.124138 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:44.124735 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:44.130666 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:44.131283 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:44.132144 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:44.132596 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:44.146918 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] HTTP exception thrown: Instance 71864169-d3ea-45e4-8e11-0a36283b817c could not be found. Aug 04 14:09:44.147526 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Returning 404 to user: Instance 71864169-d3ea-45e4-8e11-0a36283b817c could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:44.148358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0687cf1b-77ec-47b8-8832-576263d2740b tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "DELETE /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 404 len: 111 microversion: 2.1 time: 0.028306 Aug 04 14:09:44.148875 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 787/1603] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:09:44 2021] DELETE /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:44.158010 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:44.158696 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: 71864169-d3ea-45e4-8e11-0a36283b817c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:44.165336 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:44.165775 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:44.166563 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:44.166989 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:44.181161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] HTTP exception thrown: Instance 71864169-d3ea-45e4-8e11-0a36283b817c could not be found. Aug 04 14:09:44.181762 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Returning 404 to user: Instance 71864169-d3ea-45e4-8e11-0a36283b817c could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:44.182568 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d0f92da1-72ef-42d9-a5ab-e962727e7d30 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c" status: 404 len: 111 microversion: 2.1 time: 0.029176 Aug 04 14:09:44.183088 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 817/1604] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:44 2021] GET /compute/v2.1/servers/71864169-d3ea-45e4-8e11-0a36283b817c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:44.569146 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e8e28f24-9396-443b-8e0f-32fbb7c6e79e tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:44.569866 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-e8e28f24-9396-443b-8e0f-32fbb7c6e79e tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:44.576089 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e8e28f24-9396-443b-8e0f-32fbb7c6e79e tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:44.576690 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e8e28f24-9396-443b-8e0f-32fbb7c6e79e tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:44.577786 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e8e28f24-9396-443b-8e0f-32fbb7c6e79e tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:44.578209 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-e8e28f24-9396-443b-8e0f-32fbb7c6e79e tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:44.712742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-e8e28f24-9396-443b-8e0f-32fbb7c6e79e tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:44.719872 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e8e28f24-9396-443b-8e0f-32fbb7c6e79e tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1314 microversion: 2.1 time: 0.155314 Aug 04 14:09:44.720551 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 788/1605] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:44 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:45.312288 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:45.312821 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:45.319347 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:45.319787 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:45.320589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:45.321018 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:45.334267 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] HTTP exception thrown: Instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 could not be found. Aug 04 14:09:45.334952 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Returning 404 to user: Instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:45.335844 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-6ca67f9a-9367-4e4d-a288-2ad1a30f4ad7 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 404 len: 111 microversion: 2.1 time: 0.027361 Aug 04 14:09:45.336409 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 818/1606] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:09:45 2021] DELETE /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:45.344306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:45.344940 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] [instance: b5a6e241-9234-4ca1-b4ca-7b90733ab705] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:45.350796 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:45.351233 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:45.351987 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:45.352465 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:45.366055 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.wsgi [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] HTTP exception thrown: Instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 could not be found. Aug 04 14:09:45.366634 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] Returning 404 to user: Instance b5a6e241-9234-4ca1-b4ca-7b90733ab705 could not be found. {{(pid=107823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:45.367446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6ebdaf66-f602-4ebb-a9bb-7052e5786ce1 tempest-AttachVolumeShelveTestJSON-103956425 tempest-AttachVolumeShelveTestJSON-103956425-project] 10.222.0.43 "GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705" status: 404 len: 111 microversion: 2.1 time: 0.026939 Aug 04 14:09:45.367980 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 789/1607] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:45 2021] GET /compute/v2.1/servers/b5a6e241-9234-4ca1-b4ca-7b90733ab705 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:45.736171 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d8d2343d-7779-4f5e-becb-6c7906bf35f9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:45.736810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d8d2343d-7779-4f5e-becb-6c7906bf35f9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:45.743325 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8d2343d-7779-4f5e-becb-6c7906bf35f9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:45.743779 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8d2343d-7779-4f5e-becb-6c7906bf35f9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:45.744583 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8d2343d-7779-4f5e-becb-6c7906bf35f9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:45.745016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d8d2343d-7779-4f5e-becb-6c7906bf35f9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:45.981624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d8d2343d-7779-4f5e-becb-6c7906bf35f9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:45.988739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d8d2343d-7779-4f5e-becb-6c7906bf35f9 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1314 microversion: 2.1 time: 0.256360 Aug 04 14:09:45.989238 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 819/1608] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:45 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:47.005043 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-c41438fe-cdb6-4d18-866e-e83cfb0632e5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:47.006548 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-c41438fe-cdb6-4d18-866e-e83cfb0632e5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:47.012688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c41438fe-cdb6-4d18-866e-e83cfb0632e5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:47.013215 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c41438fe-cdb6-4d18-866e-e83cfb0632e5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:47.014064 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c41438fe-cdb6-4d18-866e-e83cfb0632e5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:47.014563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-c41438fe-cdb6-4d18-866e-e83cfb0632e5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:47.148072 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-c41438fe-cdb6-4d18-866e-e83cfb0632e5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:47.156600 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-c41438fe-cdb6-4d18-866e-e83cfb0632e5 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1314 microversion: 2.1 time: 0.155249 Aug 04 14:09:47.157440 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 790/1609] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:47 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:48.174714 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4d0ac607-f27d-4025-b706-e2bcbaef0c5b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:48.175341 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4d0ac607-f27d-4025-b706-e2bcbaef0c5b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:48.184954 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4d0ac607-f27d-4025-b706-e2bcbaef0c5b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:48.186270 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4d0ac607-f27d-4025-b706-e2bcbaef0c5b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:48.187154 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4d0ac607-f27d-4025-b706-e2bcbaef0c5b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:48.187661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4d0ac607-f27d-4025-b706-e2bcbaef0c5b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:48.381129 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4d0ac607-f27d-4025-b706-e2bcbaef0c5b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:48.390443 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4d0ac607-f27d-4025-b706-e2bcbaef0c5b tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1314 microversion: 2.1 time: 0.219464 Aug 04 14:09:48.391169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 820/1610] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:48 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:49.414398 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6e32fa71-03c9-46d0-b0fb-163d0922c299 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:49.415950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-f328fbe5-b1f0-48b6-9287-67643df1cc14 req-570ad65b-f20d-4d53-a851-d043375ba74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d60279-e34e-43e7-83d1-4c07482e7a82", "name": "network-vif-plugged", "status": "completed", "tag": "000d1613-bbc3-4ba7-9353-ae925bee885c"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:49.417288 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-6e32fa71-03c9-46d0-b0fb-163d0922c299 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:49.418859 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:09:49.418859 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:09:49.430502 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6e32fa71-03c9-46d0-b0fb-163d0922c299 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:49.430961 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6e32fa71-03c9-46d0-b0fb-163d0922c299 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:49.431745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6e32fa71-03c9-46d0-b0fb-163d0922c299 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:49.432298 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-6e32fa71-03c9-46d0-b0fb-163d0922c299 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:49.437281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-f328fbe5-b1f0-48b6-9287-67643df1cc14 req-570ad65b-f20d-4d53-a851-d043375ba74a service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:49.437719 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-f328fbe5-b1f0-48b6-9287-67643df1cc14 req-570ad65b-f20d-4d53-a851-d043375ba74a service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:49.454831 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-f328fbe5-b1f0-48b6-9287-67643df1cc14 req-570ad65b-f20d-4d53-a851-d043375ba74a service nova] Creating event network-vif-plugged:000d1613-bbc3-4ba7-9353-ae925bee885c for instance 84d60279-e34e-43e7-83d1-4c07482e7a82 on hv-cinder-79264 Aug 04 14:09:49.461973 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-f328fbe5-b1f0-48b6-9287-67643df1cc14 req-570ad65b-f20d-4d53-a851-d043375ba74a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051865 Aug 04 14:09:49.462932 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 821/1611] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:09:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:49.575671 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-6e32fa71-03c9-46d0-b0fb-163d0922c299 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:49.584466 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6e32fa71-03c9-46d0-b0fb-163d0922c299 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1314 microversion: 2.1 time: 0.179301 Aug 04 14:09:49.585063 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 791/1612] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:49 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:50.602732 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1e4d1a30-aa3a-441d-9e87-c00d9ec39245 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:50.603348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1e4d1a30-aa3a-441d-9e87-c00d9ec39245 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:50.609429 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e4d1a30-aa3a-441d-9e87-c00d9ec39245 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:50.609875 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e4d1a30-aa3a-441d-9e87-c00d9ec39245 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:50.610641 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e4d1a30-aa3a-441d-9e87-c00d9ec39245 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:50.611079 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1e4d1a30-aa3a-441d-9e87-c00d9ec39245 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:50.734950 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1e4d1a30-aa3a-441d-9e87-c00d9ec39245 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:50.742176 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1e4d1a30-aa3a-441d-9e87-c00d9ec39245 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1314 microversion: 2.1 time: 0.144261 Aug 04 14:09:50.742730 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 822/1613] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:50 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:51.254658 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-907a0c8c-2c05-4173-90ae-b861a7464638 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe81213160>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:51.305608 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-907a0c8c-2c05-4173-90ae-b861a7464638 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/4485d924-1830-4c4c-b621-f3e2cb902902" status: 200 len: 350 microversion: 2.1 time: 0.054395 Aug 04 14:09:51.306178 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 792/1614] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:09:51 2021] GET /compute/v2.1/os-volumes/4485d924-1830-4c4c-b621-f3e2cb902902 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:51.758924 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-65e13747-6897-4195-970d-57a29bc1c046 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:51.759540 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-65e13747-6897-4195-970d-57a29bc1c046 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:51.765388 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-65e13747-6897-4195-970d-57a29bc1c046 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:51.765835 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-65e13747-6897-4195-970d-57a29bc1c046 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:51.766603 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-65e13747-6897-4195-970d-57a29bc1c046 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:51.767030 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-65e13747-6897-4195-970d-57a29bc1c046 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:51.893605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-65e13747-6897-4195-970d-57a29bc1c046 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:51.901036 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-65e13747-6897-4195-970d-57a29bc1c046 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1499 microversion: 2.1 time: 0.146469 Aug 04 14:09:51.901602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 823/1615] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:51 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1499 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:52.483289 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-84ca3d82-daf0-405f-8b1c-3d84bfc2230a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:52.483826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-84ca3d82-daf0-405f-8b1c-3d84bfc2230a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:52.489683 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-84ca3d82-daf0-405f-8b1c-3d84bfc2230a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:52.490832 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-84ca3d82-daf0-405f-8b1c-3d84bfc2230a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:52.491583 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-84ca3d82-daf0-405f-8b1c-3d84bfc2230a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:52.492014 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-84ca3d82-daf0-405f-8b1c-3d84bfc2230a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:52.516430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-84ca3d82-daf0-405f-8b1c-3d84bfc2230a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:09:52.591264 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-84ca3d82-daf0-405f-8b1c-3d84bfc2230a tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "DELETE /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 204 len: 0 microversion: 2.1 time: 0.111226 Aug 04 14:09:52.591881 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 793/1616] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:09:52 2021] DELETE /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:52.601825 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4b66d2fb-8fd2-4ec0-b3ba-7e7f6b95538d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:52.602441 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4b66d2fb-8fd2-4ec0-b3ba-7e7f6b95538d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:52.611064 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4b66d2fb-8fd2-4ec0-b3ba-7e7f6b95538d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:52.611802 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4b66d2fb-8fd2-4ec0-b3ba-7e7f6b95538d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:52.613169 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4b66d2fb-8fd2-4ec0-b3ba-7e7f6b95538d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:52.613879 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4b66d2fb-8fd2-4ec0-b3ba-7e7f6b95538d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:52.651134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-e2d29db0-5c4a-4bd5-b62e-d2410340a77a tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe7c3c0670>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:52.704305 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-e2d29db0-5c4a-4bd5-b62e-d2410340a77a tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/4017d90b-334b-4f85-8aeb-48a5778977cc" status: 200 len: 351 microversion: 2.1 time: 0.057646 Aug 04 14:09:52.704884 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 794/1617] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:09:52 2021] GET /compute/v2.1/os-volumes/4017d90b-334b-4f85-8aeb-48a5778977cc => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:09:52.747794 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4b66d2fb-8fd2-4ec0-b3ba-7e7f6b95538d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:52.755029 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4b66d2fb-8fd2-4ec0-b3ba-7e7f6b95538d tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1505 microversion: 2.1 time: 0.158570 Aug 04 14:09:52.756360 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 824/1618] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:52 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:53.773833 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-4534d5f7-f5a3-405b-8f62-24ab9c928921 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:53.774559 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-4534d5f7-f5a3-405b-8f62-24ab9c928921 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:53.780416 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4534d5f7-f5a3-405b-8f62-24ab9c928921 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:53.780865 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4534d5f7-f5a3-405b-8f62-24ab9c928921 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:53.781627 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4534d5f7-f5a3-405b-8f62-24ab9c928921 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:53.782056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-4534d5f7-f5a3-405b-8f62-24ab9c928921 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:53.902850 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-4534d5f7-f5a3-405b-8f62-24ab9c928921 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:53.910050 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-4534d5f7-f5a3-405b-8f62-24ab9c928921 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1505 microversion: 2.1 time: 0.140222 Aug 04 14:09:53.910705 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 795/1619] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:53 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1505 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:54.030996 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-b7666436-e426-4849-b4ad-6935b6e1ac58 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe81099d30>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.083670 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-b7666436-e426-4849-b4ad-6935b6e1ac58 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/39ebfec7-759f-4520-a67f-88ee585512c1" status: 200 len: 350 microversion: 2.1 time: 0.056221 Aug 04 14:09:54.084981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 825/1620] 10.222.0.43 () {58 vars in 1245 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes/39ebfec7-759f-4520-a67f-88ee585512c1 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:54.095873 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3917611d-dced-4802-9fd5-4b688b912aa5 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe7c464ee0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.177520 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3917611d-dced-4802-9fd5-4b688b912aa5 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085214 Aug 04 14:09:54.178292 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 796/1621] 10.222.0.43 () {58 vars in 1134 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:54.190058 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-567fd4fe-f77d-46a2-8e2a-15857d7ba8d3 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe81099160>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.269082 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-567fd4fe-f77d-46a2-8e2a-15857d7ba8d3 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082575 Aug 04 14:09:54.269840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 826/1622] 10.222.0.43 () {58 vars in 1149 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:54.282660 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2860ee40-b453-4efa-a172-f83e45cb3277 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe7c2ef5e0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.364421 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2860ee40-b453-4efa-a172-f83e45cb3277 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085297 Aug 04 14:09:54.365258 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 797/1623] 10.222.0.43 () {58 vars in 1134 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:54.375882 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-8a9201f8-67b6-47b4-b757-7e2f532df4ed tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe81090ca0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.471454 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-8a9201f8-67b6-47b4-b757-7e2f532df4ed tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099087 Aug 04 14:09:54.472165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 827/1624] 10.222.0.43 () {58 vars in 1167 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:54.485482 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d4706cf0-5760-47ed-aedf-0cd9ff3a1b95 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe81213af0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.572351 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d4706cf0-5760-47ed-aedf-0cd9ff3a1b95 tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091708 Aug 04 14:09:54.572823 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 798/1625] 10.222.0.43 () {58 vars in 1170 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:54.585350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-61c49e06-3569-4fe6-a980-929097b3e59d tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe8118eee0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.666889 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-61c49e06-3569-4fe6-a980-929097b3e59d tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085404 Aug 04 14:09:54.667974 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 828/1626] 10.222.0.43 () {58 vars in 1155 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:54.679714 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-6476305c-5c27-4fcd-9e41-70de4f92086a tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe7c31f4c0>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.775252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-6476305c-5c27-4fcd-9e41-70de4f92086a tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100309 Aug 04 14:09:54.775947 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 799/1627] 10.222.0.43 () {58 vars in 1188 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:09:54.788021 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-61530ad0-b68a-4eda-8295-47338d62cc3d tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] Calling method '.version_select at 0x7efe810121f0>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.798195 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-2d5cda82-3178-4baa-a63c-afb4d18a46ab req-a7d36c9c-3ec5-4277-8e1f-53ece1dc9aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d60279-e34e-43e7-83d1-4c07482e7a82", "name": "network-vif-deleted", "tag": "000d1613-bbc3-4ba7-9353-ae925bee885c"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:54.800184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:09:54.800184 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:09:54.809353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-2d5cda82-3178-4baa-a63c-afb4d18a46ab req-a7d36c9c-3ec5-4277-8e1f-53ece1dc9aba service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:54.809797 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-2d5cda82-3178-4baa-a63c-afb4d18a46ab req-a7d36c9c-3ec5-4277-8e1f-53ece1dc9aba service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:54.821563 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-2d5cda82-3178-4baa-a63c-afb4d18a46ab req-a7d36c9c-3ec5-4277-8e1f-53ece1dc9aba service nova] Creating event network-vif-deleted:000d1613-bbc3-4ba7-9353-ae925bee885c for instance 84d60279-e34e-43e7-83d1-4c07482e7a82 on hv-cinder-79264 Aug 04 14:09:54.826678 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-2d5cda82-3178-4baa-a63c-afb4d18a46ab req-a7d36c9c-3ec5-4277-8e1f-53ece1dc9aba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035892 Aug 04 14:09:54.827360 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 800/1628] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:09:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:54.877987 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-61530ad0-b68a-4eda-8295-47338d62cc3d tempest-VolumesTestJSON-519386674 tempest-VolumesTestJSON-519386674-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094412 Aug 04 14:09:54.878700 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 829/1629] 10.222.0.43 () {58 vars in 1155 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:54.927551 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.928780 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:54.935027 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:54.935475 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:54.936284 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:54.936719 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:54.976860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:54.977296 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:54.977783 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lazy-loading 'fault' on Instance uuid 84d60279-e34e-43e7-83d1-4c07482e7a82 {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:09:55.020392 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46264c746204ed7a219299c43fef604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b932d0ef1914db09ea397e5e2b19a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:55.027701 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-861cc454-870f-4a88-990f-1f0789f792f3 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 200 len: 1304 microversion: 2.1 time: 0.104489 Aug 04 14:09:55.028287 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 801/1630] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:54 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:56.044607 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:56.045355 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] [instance: 84d60279-e34e-43e7-83d1-4c07482e7a82] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:09:56.051975 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:56.052466 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:56.053308 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:09:56.054290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:09:56.067671 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] HTTP exception thrown: Instance 84d60279-e34e-43e7-83d1-4c07482e7a82 could not be found. Aug 04 14:09:56.068306 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] Returning 404 to user: Instance 84d60279-e34e-43e7-83d1-4c07482e7a82 could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:09:56.069352 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-35bcb9bb-2e14-4bb7-ab0e-0be752cecb57 tempest-VolumesActionsTest-1562514836 tempest-VolumesActionsTest-1562514836-project] 10.222.0.43 "GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82" status: 404 len: 111 microversion: 2.1 time: 0.028334 Aug 04 14:09:56.070059 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 830/1631] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:09:56 2021] GET /compute/v2.1/servers/84d60279-e34e-43e7-83d1-4c07482e7a82 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:12:00.794474 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:12:00.795112 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:12:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:12:18.083739 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:12:18.084489 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:12:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:12:18.702970 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3a3344-7933-4f44-b101-0fa2c3ed818a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 14:12:18.904840 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-37dcb2d9-92d2-4365-8093-149f17b5e098 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Action: 'create', calling method: .version_select at 0x7efe7c3033a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-681448557"}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:18.928850 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-37dcb2d9-92d2-4365-8093-149f17b5e098 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Getting quotas for project 835631bcfda04e928702f87e8c8ce56d. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:12:18.933394 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-37dcb2d9-92d2-4365-8093-149f17b5e098 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Getting quotas for user 41b5e49a7af042d1b3d6fe25d65fcb41 and project 835631bcfda04e928702f87e8c8ce56d. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:12:19.170860 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-37dcb2d9-92d2-4365-8093-149f17b5e098 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Getting quotas for project 835631bcfda04e928702f87e8c8ce56d. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:12:19.174667 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.quota [None req-37dcb2d9-92d2-4365-8093-149f17b5e098 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Getting quotas for user 41b5e49a7af042d1b3d6fe25d65fcb41 and project 835631bcfda04e928702f87e8c8ce56d. Resources: {'key_pairs'} {{(pid=107823) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:12:19.187704 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-37dcb2d9-92d2-4365-8093-149f17b5e098 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.486706 Aug 04 14:12:19.188697 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 802/1632] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Aug 4 14:12:18 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:42.919746 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8f65dfee-1faa-4d05-bc44-151d18494a17] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 14:12:42.923503 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1342746112", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-681448557", "security_groups": [{"name": "tempest-secgroup-smoke-1299224744"}], "networks": [{"uuid": "d29e8435-9c12-4c39-afa0-cf8e7845aac3"}], "block_device_mapping_v2": [{"uuid": "017f578f-aed7-41b6-b899-9984fd4d4ffa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:43.120509 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.network.neutron [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] validate_networks() for [('d29e8435-9c12-4c39-afa0-cf8e7845aac3', None, None, None)] {{(pid=107822) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 04 14:12:43.480398 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Flavor limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:12:43.480817 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Image limits 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:12:43.481281 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Flavor pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:12:43.481681 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Image pref 0:0:0 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:12:43.482086 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.virt.hardware [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:12:43.492061 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:43.492536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:43.493332 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:43.493760 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:43.510823 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Getting quotas for project 835631bcfda04e928702f87e8c8ce56d. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 04 14:12:43.515390 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.quota [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Getting quotas for user 41b5e49a7af042d1b3d6fe25d65fcb41 and project 835631bcfda04e928702f87e8c8ce56d. Resources: {'cores', 'instances', 'ram'} {{(pid=107822) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 04 14:12:43.580871 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Going to run 1 instances... {{(pid=107822) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 04 14:12:43.583327 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='017f578f-aed7-41b6-b899-9984fd4d4ffa',volume_size=None,volume_type=None)] {{(pid=107822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 04 14:12:43.708901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-08ea5df8-05bb-4b52-a2bc-479556758e19 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.790818 Aug 04 14:12:43.709536 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 831/1633] 10.222.0.43 () {60 vars in 1147 bytes} [Wed Aug 4 14:12:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:12:43.731185 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-46c26000-f1a2-4115-863f-104f81346b9b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:43.731742 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-46c26000-f1a2-4115-863f-104f81346b9b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:43.743676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3a3344-7933-4f44-b101-0fa2c3ed818a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41472. Aug 04 14:12:43.893159 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-46c26000-f1a2-4115-863f-104f81346b9b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:43.899769 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-46c26000-f1a2-4115-863f-104f81346b9b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1088 microversion: 2.1 time: 0.184108 Aug 04 14:12:43.900433 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 803/1634] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:43 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1088 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:44.929183 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-a018a70c-250b-4574-83a7-fdfea0a44657 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:44.929910 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-a018a70c-250b-4574-83a7-fdfea0a44657 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:44.937712 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a018a70c-250b-4574-83a7-fdfea0a44657 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:44.938267 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a018a70c-250b-4574-83a7-fdfea0a44657 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:44.939126 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a018a70c-250b-4574-83a7-fdfea0a44657 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:44.939554 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-a018a70c-250b-4574-83a7-fdfea0a44657 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:44.944790 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] [8f65dfee-1faa-4d05-bc44-151d18494a17] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41488. Aug 04 14:12:45.008145 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-a018a70c-250b-4574-83a7-fdfea0a44657 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:45.015564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-a018a70c-250b-4574-83a7-fdfea0a44657 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1204 microversion: 2.1 time: 0.102209 Aug 04 14:12:45.016131 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 832/1635] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:44 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:46.032327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a5ce635c-0351-4d4b-a170-506af6b3fdac tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:46.034477 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a5ce635c-0351-4d4b-a170-506af6b3fdac tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:46.039428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5ce635c-0351-4d4b-a170-506af6b3fdac tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:46.039767 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5ce635c-0351-4d4b-a170-506af6b3fdac tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:46.040676 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5ce635c-0351-4d4b-a170-506af6b3fdac tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:46.041200 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a5ce635c-0351-4d4b-a170-506af6b3fdac tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:46.197374 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-022b7cae-4eb6-47b7-8232-69da6e6852c5 req-5013c3cc-fa6b-4de3-ab7f-4fb9c90bf5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd01693-99b6-432d-9f29-398436ac094c", "tag": "ebae422b-a52d-4e9b-b4af-0690ae37c4d6"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:46.199004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:12:46.199004 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:12:46.209444 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-022b7cae-4eb6-47b7-8232-69da6e6852c5 req-5013c3cc-fa6b-4de3-ab7f-4fb9c90bf5be service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:46.209902 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-022b7cae-4eb6-47b7-8232-69da6e6852c5 req-5013c3cc-fa6b-4de3-ab7f-4fb9c90bf5be service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:46.222069 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-022b7cae-4eb6-47b7-8232-69da6e6852c5 req-5013c3cc-fa6b-4de3-ab7f-4fb9c90bf5be service nova] Creating event network-changed:ebae422b-a52d-4e9b-b4af-0690ae37c4d6 for instance 7dd01693-99b6-432d-9f29-398436ac094c on hv-cinder-79264 Aug 04 14:12:46.229857 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-022b7cae-4eb6-47b7-8232-69da6e6852c5 req-5013c3cc-fa6b-4de3-ab7f-4fb9c90bf5be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036638 Aug 04 14:12:46.231100 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 833/1636] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:12:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:46.269743 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a5ce635c-0351-4d4b-a170-506af6b3fdac tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:46.278521 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a5ce635c-0351-4d4b-a170-506af6b3fdac tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.249991 Aug 04 14:12:46.288042 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 804/1637] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:46 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:47.296270 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e8890a53-2fd3-4541-b0bc-0f319c3aefec tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:47.296979 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e8890a53-2fd3-4541-b0bc-0f319c3aefec tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:47.304117 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8890a53-2fd3-4541-b0bc-0f319c3aefec tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:47.304587 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8890a53-2fd3-4541-b0bc-0f319c3aefec tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:47.305375 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8890a53-2fd3-4541-b0bc-0f319c3aefec tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:47.305808 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e8890a53-2fd3-4541-b0bc-0f319c3aefec tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:47.431930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e8890a53-2fd3-4541-b0bc-0f319c3aefec tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:47.439253 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e8890a53-2fd3-4541-b0bc-0f319c3aefec tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.147143 Aug 04 14:12:47.439826 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 834/1638] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:47 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:48.455952 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-81095e79-581a-4187-831c-df89736efd99 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:48.456868 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-81095e79-581a-4187-831c-df89736efd99 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:48.463595 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-81095e79-581a-4187-831c-df89736efd99 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:48.464040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-81095e79-581a-4187-831c-df89736efd99 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:48.464864 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-81095e79-581a-4187-831c-df89736efd99 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:48.465297 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-81095e79-581a-4187-831c-df89736efd99 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:48.587168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-81095e79-581a-4187-831c-df89736efd99 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:48.594327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-81095e79-581a-4187-831c-df89736efd99 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.142202 Aug 04 14:12:48.594897 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 805/1639] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:48 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:49.610833 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d15e957c-59f0-415e-bc1a-356d5dd75054 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:49.611430 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d15e957c-59f0-415e-bc1a-356d5dd75054 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:49.619024 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d15e957c-59f0-415e-bc1a-356d5dd75054 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:49.619411 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d15e957c-59f0-415e-bc1a-356d5dd75054 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:49.620164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d15e957c-59f0-415e-bc1a-356d5dd75054 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:49.620612 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d15e957c-59f0-415e-bc1a-356d5dd75054 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:49.740529 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d15e957c-59f0-415e-bc1a-356d5dd75054 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:49.747914 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d15e957c-59f0-415e-bc1a-356d5dd75054 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.140784 Aug 04 14:12:49.748515 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 835/1640] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:49 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:50.764956 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-080bdf7e-a009-45be-8ac0-e7a9e64fccdf tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:50.765565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-080bdf7e-a009-45be-8ac0-e7a9e64fccdf tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:50.771468 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-080bdf7e-a009-45be-8ac0-e7a9e64fccdf tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:50.772084 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-080bdf7e-a009-45be-8ac0-e7a9e64fccdf tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:50.772877 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-080bdf7e-a009-45be-8ac0-e7a9e64fccdf tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:50.773307 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-080bdf7e-a009-45be-8ac0-e7a9e64fccdf tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:50.902501 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-080bdf7e-a009-45be-8ac0-e7a9e64fccdf tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:50.909590 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-080bdf7e-a009-45be-8ac0-e7a9e64fccdf tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.148331 Aug 04 14:12:50.910157 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 806/1641] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:50 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:51.926617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e0d6f8d3-3bff-4157-a7ff-87037321cf39 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:51.927815 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e0d6f8d3-3bff-4157-a7ff-87037321cf39 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:51.933653 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e0d6f8d3-3bff-4157-a7ff-87037321cf39 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:51.934095 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e0d6f8d3-3bff-4157-a7ff-87037321cf39 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:51.934866 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e0d6f8d3-3bff-4157-a7ff-87037321cf39 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:51.935299 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e0d6f8d3-3bff-4157-a7ff-87037321cf39 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:52.057673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e0d6f8d3-3bff-4157-a7ff-87037321cf39 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:52.064993 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e0d6f8d3-3bff-4157-a7ff-87037321cf39 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.142148 Aug 04 14:12:52.065564 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 836/1642] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:51 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:53.082381 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-b66f4918-6c35-4579-ac12-e181a300a53a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:53.082988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-b66f4918-6c35-4579-ac12-e181a300a53a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:53.089126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b66f4918-6c35-4579-ac12-e181a300a53a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:53.089589 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b66f4918-6c35-4579-ac12-e181a300a53a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:53.090543 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b66f4918-6c35-4579-ac12-e181a300a53a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:53.091056 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-b66f4918-6c35-4579-ac12-e181a300a53a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:53.213736 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-b66f4918-6c35-4579-ac12-e181a300a53a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:53.220959 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-b66f4918-6c35-4579-ac12-e181a300a53a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.142492 Aug 04 14:12:53.221530 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 807/1643] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:53 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:54.237621 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-ccc00df0-203d-449b-b7b0-0d65a247850d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:54.238256 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-ccc00df0-203d-449b-b7b0-0d65a247850d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:54.251997 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ccc00df0-203d-449b-b7b0-0d65a247850d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:54.252546 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ccc00df0-203d-449b-b7b0-0d65a247850d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:54.253319 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ccc00df0-203d-449b-b7b0-0d65a247850d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:54.253749 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-ccc00df0-203d-449b-b7b0-0d65a247850d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:54.378089 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-ccc00df0-203d-449b-b7b0-0d65a247850d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:54.385716 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-ccc00df0-203d-449b-b7b0-0d65a247850d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.151781 Aug 04 14:12:54.386309 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 837/1644] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:54 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:55.403772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ffd647e6-ea58-461c-bbda-9ae9044aa6b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:55.404537 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ffd647e6-ea58-461c-bbda-9ae9044aa6b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:55.410430 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ffd647e6-ea58-461c-bbda-9ae9044aa6b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:55.410880 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ffd647e6-ea58-461c-bbda-9ae9044aa6b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:55.411689 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ffd647e6-ea58-461c-bbda-9ae9044aa6b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:55.412126 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ffd647e6-ea58-461c-bbda-9ae9044aa6b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:55.535181 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ffd647e6-ea58-461c-bbda-9ae9044aa6b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:55.542765 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ffd647e6-ea58-461c-bbda-9ae9044aa6b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.143499 Aug 04 14:12:55.543539 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 808/1645] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:55 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:56.559165 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-07c144f7-2603-4489-80fe-1518da14282d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:56.559774 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-07c144f7-2603-4489-80fe-1518da14282d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:56.565661 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07c144f7-2603-4489-80fe-1518da14282d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:56.566108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07c144f7-2603-4489-80fe-1518da14282d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:56.566879 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07c144f7-2603-4489-80fe-1518da14282d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:56.567305 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-07c144f7-2603-4489-80fe-1518da14282d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:56.696921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-07c144f7-2603-4489-80fe-1518da14282d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:56.704155 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-07c144f7-2603-4489-80fe-1518da14282d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.148724 Aug 04 14:12:56.704744 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 838/1646] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:56 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:57.655569 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-2043908e-7b23-4495-8787-68a17b520289 req-62aa6998-c318-4289-a478-2b7711056ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd01693-99b6-432d-9f29-398436ac094c", "name": "network-vif-plugged", "status": "completed", "tag": "ebae422b-a52d-4e9b-b4af-0690ae37c4d6"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:57.657472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:12:57.657472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:12:57.665765 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-2043908e-7b23-4495-8787-68a17b520289 req-62aa6998-c318-4289-a478-2b7711056ea7 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:57.677931 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-2043908e-7b23-4495-8787-68a17b520289 req-62aa6998-c318-4289-a478-2b7711056ea7 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:57.683749 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-2043908e-7b23-4495-8787-68a17b520289 req-62aa6998-c318-4289-a478-2b7711056ea7 service nova] Creating event network-vif-plugged:ebae422b-a52d-4e9b-b4af-0690ae37c4d6 for instance 7dd01693-99b6-432d-9f29-398436ac094c on hv-cinder-79264 Aug 04 14:12:57.694166 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-2043908e-7b23-4495-8787-68a17b520289 req-62aa6998-c318-4289-a478-2b7711056ea7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107106 Aug 04 14:12:57.694921 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 809/1647] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:12:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:57.721391 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1f6ce712-10ca-4e18-a79a-de849f213188 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:57.722142 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1f6ce712-10ca-4e18-a79a-de849f213188 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:57.728868 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f6ce712-10ca-4e18-a79a-de849f213188 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:57.729614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f6ce712-10ca-4e18-a79a-de849f213188 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:57.730084 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f6ce712-10ca-4e18-a79a-de849f213188 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:57.730514 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1f6ce712-10ca-4e18-a79a-de849f213188 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:57.891068 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1f6ce712-10ca-4e18-a79a-de849f213188 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:57.903147 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1f6ce712-10ca-4e18-a79a-de849f213188 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.185526 Aug 04 14:12:57.903725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 839/1648] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:57 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:58.920855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-2aa454f3-6651-4642-bb46-fb7bc34152f0 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:58.921581 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-2aa454f3-6651-4642-bb46-fb7bc34152f0 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:12:58.927970 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2aa454f3-6651-4642-bb46-fb7bc34152f0 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:58.928447 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2aa454f3-6651-4642-bb46-fb7bc34152f0 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:58.929234 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2aa454f3-6651-4642-bb46-fb7bc34152f0 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:12:58.929671 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-2aa454f3-6651-4642-bb46-fb7bc34152f0 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:12:59.051191 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-2aa454f3-6651-4642-bb46-fb7bc34152f0 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:59.058499 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-2aa454f3-6651-4642-bb46-fb7bc34152f0 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1260 microversion: 2.1 time: 0.141668 Aug 04 14:12:59.059069 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 810/1649] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:12:58 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1260 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:00.075196 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e0211639-2643-4ebb-8a0d-15b79d4f2960 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:00.075788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e0211639-2643-4ebb-8a0d-15b79d4f2960 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:13:00.082053 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e0211639-2643-4ebb-8a0d-15b79d4f2960 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:13:00.082494 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e0211639-2643-4ebb-8a0d-15b79d4f2960 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:13:00.083286 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e0211639-2643-4ebb-8a0d-15b79d4f2960 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:13:00.084441 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e0211639-2643-4ebb-8a0d-15b79d4f2960 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:13:00.202938 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e0211639-2643-4ebb-8a0d-15b79d4f2960 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:00.210589 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e0211639-2643-4ebb-8a0d-15b79d4f2960 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1443 microversion: 2.1 time: 0.139119 Aug 04 14:13:00.211150 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 840/1650] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:13:00 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1443 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:00.226194 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-768ae039-b042-40ef-be29-443c640ea36f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:00.226822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-768ae039-b042-40ef-be29-443c640ea36f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:13:00.232689 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-768ae039-b042-40ef-be29-443c640ea36f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:13:00.233131 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-768ae039-b042-40ef-be29-443c640ea36f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:13:00.233896 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-768ae039-b042-40ef-be29-443c640ea36f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:13:00.234327 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-768ae039-b042-40ef-be29-443c640ea36f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:13:00.355252 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-768ae039-b042-40ef-be29-443c640ea36f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:00.362582 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-768ae039-b042-40ef-be29-443c640ea36f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1443 microversion: 2.1 time: 0.140134 Aug 04 14:13:00.363165 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 811/1651] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:13:00 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1443 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:02.010407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-d579e170-c0eb-499b-b6ce-c68ee44f1d69 req-ae64df50-5ede-4319-b504-6ae2beb7602c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd01693-99b6-432d-9f29-398436ac094c", "tag": "ebae422b-a52d-4e9b-b4af-0690ae37c4d6"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:02.012107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:13:02.012107 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:13:02.019383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-d579e170-c0eb-499b-b6ce-c68ee44f1d69 req-ae64df50-5ede-4319-b504-6ae2beb7602c service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:13:02.019830 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-d579e170-c0eb-499b-b6ce-c68ee44f1d69 req-ae64df50-5ede-4319-b504-6ae2beb7602c service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:13:02.031407 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-d579e170-c0eb-499b-b6ce-c68ee44f1d69 req-ae64df50-5ede-4319-b504-6ae2beb7602c service nova] Creating event network-changed:ebae422b-a52d-4e9b-b4af-0690ae37c4d6 for instance 7dd01693-99b6-432d-9f29-398436ac094c on hv-cinder-79264 Aug 04 14:13:02.036350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-d579e170-c0eb-499b-b6ce-c68ee44f1d69 req-ae64df50-5ede-4319-b504-6ae2beb7602c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029668 Aug 04 14:13:02.037364 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 841/1652] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:13:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:46.126961 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:13:46.127655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:13:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:14:59.006134 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:14:59.006779 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:14:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:15:15.843386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:15.844082 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:15.850050 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:15.850491 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:15.851245 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:15.851670 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:15.874288 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.objects.instance [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lazy-loading 'flavor' on Instance uuid 7dd01693-99b6-432d-9f29-398436ac094c {{(pid=107823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:15:15.942957 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [b40518d9-a522-468a-97b8-88fa0ca20369] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:15:16.959402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [b40518d9-a522-468a-97b8-88fa0ca20369] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41580. Aug 04 14:15:16.962604 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bffa59e6-6cf8-486a-bbb1-ce4073f4af0d tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "POST /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c/action" status: 202 len: 0 microversion: 2.1 time: 1.124232 Aug 04 14:15:16.963208 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 812/1653] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:15:15 2021] POST /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c/action => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:15:16.969656 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8f65dfee-1faa-4d05-bc44-151d18494a17] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 14:15:16.973511 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4db52357-28c7-4db6-847f-24853ff6d39c tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:16.974298 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4db52357-28c7-4db6-847f-24853ff6d39c tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:16.980350 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4db52357-28c7-4db6-847f-24853ff6d39c tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:16.980798 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4db52357-28c7-4db6-847f-24853ff6d39c tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:16.982214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4db52357-28c7-4db6-847f-24853ff6d39c tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:16.982639 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4db52357-28c7-4db6-847f-24853ff6d39c tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:17.109130 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4db52357-28c7-4db6-847f-24853ff6d39c tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:17.116527 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4db52357-28c7-4db6-847f-24853ff6d39c tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.148818 Aug 04 14:15:17.117075 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 842/1654] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:16 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:17.733067 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:15:17.733305 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:15:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:15:18.133450 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-81083c22-44df-4c3c-a894-9012fb6f39b3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:18.134096 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-81083c22-44df-4c3c-a894-9012fb6f39b3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:18.140760 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-81083c22-44df-4c3c-a894-9012fb6f39b3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:18.141197 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-81083c22-44df-4c3c-a894-9012fb6f39b3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:18.141944 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-81083c22-44df-4c3c-a894-9012fb6f39b3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:18.142366 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-81083c22-44df-4c3c-a894-9012fb6f39b3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:18.411973 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-81083c22-44df-4c3c-a894-9012fb6f39b3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:18.419730 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-81083c22-44df-4c3c-a894-9012fb6f39b3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.290365 Aug 04 14:15:18.420306 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 813/1655] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:18 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:19.437502 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-4c92c302-a0d2-483e-bc1b-1f2e5c9f74ad tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:19.438115 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-4c92c302-a0d2-483e-bc1b-1f2e5c9f74ad tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:19.456178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c92c302-a0d2-483e-bc1b-1f2e5c9f74ad tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:19.456655 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c92c302-a0d2-483e-bc1b-1f2e5c9f74ad tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:19.457438 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c92c302-a0d2-483e-bc1b-1f2e5c9f74ad tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:19.457869 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-4c92c302-a0d2-483e-bc1b-1f2e5c9f74ad tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:19.463859 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] [8f65dfee-1faa-4d05-bc44-151d18494a17] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41594. Aug 04 14:15:19.578610 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-4c92c302-a0d2-483e-bc1b-1f2e5c9f74ad tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:19.586141 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-4c92c302-a0d2-483e-bc1b-1f2e5c9f74ad tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.153191 Aug 04 14:15:19.586695 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 843/1656] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:19 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:20.602876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-ff2babc5-2854-40cf-9c42-a0475aa10fe5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:20.603419 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-ff2babc5-2854-40cf-9c42-a0475aa10fe5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:20.609565 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff2babc5-2854-40cf-9c42-a0475aa10fe5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:20.609955 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff2babc5-2854-40cf-9c42-a0475aa10fe5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:20.610716 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff2babc5-2854-40cf-9c42-a0475aa10fe5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:20.611137 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-ff2babc5-2854-40cf-9c42-a0475aa10fe5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:20.736988 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-ff2babc5-2854-40cf-9c42-a0475aa10fe5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:20.744972 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-ff2babc5-2854-40cf-9c42-a0475aa10fe5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.145892 Aug 04 14:15:20.745532 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 814/1657] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:20 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:15:21.762584 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-bf4062c4-202b-4ef0-99be-ea5b70b86ab9 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:21.763195 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-bf4062c4-202b-4ef0-99be-ea5b70b86ab9 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:21.769269 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bf4062c4-202b-4ef0-99be-ea5b70b86ab9 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:21.769718 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bf4062c4-202b-4ef0-99be-ea5b70b86ab9 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:21.770496 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bf4062c4-202b-4ef0-99be-ea5b70b86ab9 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:21.770933 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-bf4062c4-202b-4ef0-99be-ea5b70b86ab9 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:21.891865 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-bf4062c4-202b-4ef0-99be-ea5b70b86ab9 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:21.899121 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-bf4062c4-202b-4ef0-99be-ea5b70b86ab9 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.140458 Aug 04 14:15:21.899683 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 844/1658] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:21 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:22.916312 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-72960fe8-2a5d-4230-bf41-bd6c37081c38 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:22.916943 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-72960fe8-2a5d-4230-bf41-bd6c37081c38 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:22.922772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-72960fe8-2a5d-4230-bf41-bd6c37081c38 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:22.923211 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-72960fe8-2a5d-4230-bf41-bd6c37081c38 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:22.923958 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-72960fe8-2a5d-4230-bf41-bd6c37081c38 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:22.924414 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-72960fe8-2a5d-4230-bf41-bd6c37081c38 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:23.042168 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-72960fe8-2a5d-4230-bf41-bd6c37081c38 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:23.050481 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-72960fe8-2a5d-4230-bf41-bd6c37081c38 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.137830 Aug 04 14:15:23.051048 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 815/1659] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:22 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:24.068293 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-e3799065-d91e-4c83-92f4-85cf6e288041 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:24.069199 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-e3799065-d91e-4c83-92f4-85cf6e288041 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:24.078039 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e3799065-d91e-4c83-92f4-85cf6e288041 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:24.078488 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e3799065-d91e-4c83-92f4-85cf6e288041 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:24.079275 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e3799065-d91e-4c83-92f4-85cf6e288041 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:24.079713 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-e3799065-d91e-4c83-92f4-85cf6e288041 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:24.207617 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-e3799065-d91e-4c83-92f4-85cf6e288041 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:24.215612 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-e3799065-d91e-4c83-92f4-85cf6e288041 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.150953 Aug 04 14:15:24.216245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 845/1660] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:24 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:15:25.233472 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-f07fadfb-6a74-4685-9fb1-43df7e05b9d3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:25.234099 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-f07fadfb-6a74-4685-9fb1-43df7e05b9d3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:25.239905 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f07fadfb-6a74-4685-9fb1-43df7e05b9d3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:25.240379 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f07fadfb-6a74-4685-9fb1-43df7e05b9d3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:25.241139 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f07fadfb-6a74-4685-9fb1-43df7e05b9d3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:25.241562 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-f07fadfb-6a74-4685-9fb1-43df7e05b9d3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:25.360745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-f07fadfb-6a74-4685-9fb1-43df7e05b9d3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:25.368072 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-f07fadfb-6a74-4685-9fb1-43df7e05b9d3 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.139167 Aug 04 14:15:25.368522 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 816/1661] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:25 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:26.384518 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-882d4b30-22e8-4d33-814d-b45597e7e07f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:26.385128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-882d4b30-22e8-4d33-814d-b45597e7e07f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:26.391555 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-882d4b30-22e8-4d33-814d-b45597e7e07f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:26.391996 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-882d4b30-22e8-4d33-814d-b45597e7e07f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:26.392783 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-882d4b30-22e8-4d33-814d-b45597e7e07f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:26.393214 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-882d4b30-22e8-4d33-814d-b45597e7e07f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:26.510247 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-882d4b30-22e8-4d33-814d-b45597e7e07f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:26.518190 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-882d4b30-22e8-4d33-814d-b45597e7e07f tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.137379 Aug 04 14:15:26.518755 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 846/1662] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:26 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:27.535160 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-d61dd1f7-5d28-4b1c-878f-668b80e76af1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:27.535745 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-d61dd1f7-5d28-4b1c-878f-668b80e76af1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:27.541717 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d61dd1f7-5d28-4b1c-878f-668b80e76af1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:27.542173 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d61dd1f7-5d28-4b1c-878f-668b80e76af1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:27.542945 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d61dd1f7-5d28-4b1c-878f-668b80e76af1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:27.543386 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-d61dd1f7-5d28-4b1c-878f-668b80e76af1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:27.664969 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-d61dd1f7-5d28-4b1c-878f-668b80e76af1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:27.672323 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-d61dd1f7-5d28-4b1c-878f-668b80e76af1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.140795 Aug 04 14:15:27.672885 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 817/1663] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:27 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:28.689811 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-5ec43fba-7858-4e2c-9516-dbc5af27460b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:28.690425 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-5ec43fba-7858-4e2c-9516-dbc5af27460b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:28.696526 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ec43fba-7858-4e2c-9516-dbc5af27460b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:28.696984 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ec43fba-7858-4e2c-9516-dbc5af27460b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:28.697753 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ec43fba-7858-4e2c-9516-dbc5af27460b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:28.698189 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-5ec43fba-7858-4e2c-9516-dbc5af27460b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:28.818314 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-5ec43fba-7858-4e2c-9516-dbc5af27460b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:28.826164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-5ec43fba-7858-4e2c-9516-dbc5af27460b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.139539 Aug 04 14:15:28.826725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 847/1664] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:28 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:29.843402 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-bd3d7f12-5099-4ee2-864c-ad8045c59463 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:29.844012 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-bd3d7f12-5099-4ee2-864c-ad8045c59463 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:29.849820 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bd3d7f12-5099-4ee2-864c-ad8045c59463 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:29.850271 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bd3d7f12-5099-4ee2-864c-ad8045c59463 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:29.851032 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bd3d7f12-5099-4ee2-864c-ad8045c59463 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:29.851459 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-bd3d7f12-5099-4ee2-864c-ad8045c59463 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:29.974806 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-bd3d7f12-5099-4ee2-864c-ad8045c59463 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:29.981974 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-bd3d7f12-5099-4ee2-864c-ad8045c59463 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.142492 Aug 04 14:15:29.982523 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 818/1665] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:29 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:30.999472 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-97bf30ec-3020-46b9-b91d-053d90587897 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:31.000103 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-97bf30ec-3020-46b9-b91d-053d90587897 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:31.005793 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97bf30ec-3020-46b9-b91d-053d90587897 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:31.006234 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97bf30ec-3020-46b9-b91d-053d90587897 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:31.006988 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97bf30ec-3020-46b9-b91d-053d90587897 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:31.007413 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97bf30ec-3020-46b9-b91d-053d90587897 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:31.127864 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-97bf30ec-3020-46b9-b91d-053d90587897 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:31.135114 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-97bf30ec-3020-46b9-b91d-053d90587897 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.140407 Aug 04 14:15:31.135674 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 848/1666] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:30 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:32.153025 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-26e48c8a-1227-4354-89ec-55a9f3d0af1a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:32.154220 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-26e48c8a-1227-4354-89ec-55a9f3d0af1a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:32.160160 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-26e48c8a-1227-4354-89ec-55a9f3d0af1a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:32.160637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-26e48c8a-1227-4354-89ec-55a9f3d0af1a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:32.161403 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-26e48c8a-1227-4354-89ec-55a9f3d0af1a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:32.161835 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-26e48c8a-1227-4354-89ec-55a9f3d0af1a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:32.303755 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-26e48c8a-1227-4354-89ec-55a9f3d0af1a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:32.311195 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-26e48c8a-1227-4354-89ec-55a9f3d0af1a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.161806 Aug 04 14:15:32.311772 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 819/1667] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:32 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:33.328624 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-c7c78f4e-97e5-4491-97ed-871162d01a64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:33.329263 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-c7c78f4e-97e5-4491-97ed-871162d01a64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:33.335440 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7c78f4e-97e5-4491-97ed-871162d01a64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:33.335884 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7c78f4e-97e5-4491-97ed-871162d01a64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:33.336673 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7c78f4e-97e5-4491-97ed-871162d01a64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:33.337108 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-c7c78f4e-97e5-4491-97ed-871162d01a64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:33.455181 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-c7c78f4e-97e5-4491-97ed-871162d01a64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.462898 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-c7c78f4e-97e5-4491-97ed-871162d01a64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.138766 Aug 04 14:15:33.463448 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 849/1668] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:33 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:34.478731 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a0808c82-8ae7-4844-869e-492fec1fa41b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:34.479420 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a0808c82-8ae7-4844-869e-492fec1fa41b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:34.485353 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a0808c82-8ae7-4844-869e-492fec1fa41b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:34.485876 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a0808c82-8ae7-4844-869e-492fec1fa41b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:34.486711 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a0808c82-8ae7-4844-869e-492fec1fa41b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:34.487170 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a0808c82-8ae7-4844-869e-492fec1fa41b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:34.607822 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a0808c82-8ae7-4844-869e-492fec1fa41b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:34.615080 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a0808c82-8ae7-4844-869e-492fec1fa41b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.140334 Aug 04 14:15:34.615642 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 820/1669] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:34 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:35.632666 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-33472719-9a72-48aa-a714-991b3ccc1d9a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:35.633245 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-33472719-9a72-48aa-a714-991b3ccc1d9a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:35.639184 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33472719-9a72-48aa-a714-991b3ccc1d9a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:35.639625 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33472719-9a72-48aa-a714-991b3ccc1d9a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:35.640418 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33472719-9a72-48aa-a714-991b3ccc1d9a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:35.640851 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-33472719-9a72-48aa-a714-991b3ccc1d9a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:35.762106 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-33472719-9a72-48aa-a714-991b3ccc1d9a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:35.771423 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-33472719-9a72-48aa-a714-991b3ccc1d9a tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1509 microversion: 2.1 time: 0.142510 Aug 04 14:15:35.771984 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 850/1670] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:35 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:35.787511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-67dcac22-24e5-479d-84c1-a1c42c9380a5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:35.788083 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-67dcac22-24e5-479d-84c1-a1c42c9380a5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:35.794510 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67dcac22-24e5-479d-84c1-a1c42c9380a5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:35.794963 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67dcac22-24e5-479d-84c1-a1c42c9380a5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:35.795813 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67dcac22-24e5-479d-84c1-a1c42c9380a5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:35.796272 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-67dcac22-24e5-479d-84c1-a1c42c9380a5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:35.869457 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-67dcac22-24e5-479d-84c1-a1c42c9380a5 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "POST /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c/action" status: 202 len: 0 microversion: 2.1 time: 0.085688 Aug 04 14:15:35.870121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 821/1671] 10.222.0.43 () {60 vars in 1278 bytes} [Wed Aug 4 14:15:35 2021] POST /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:15:35.878679 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-356bba8b-9672-456b-b509-374b8f1ada64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:35.879290 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-356bba8b-9672-456b-b509-374b8f1ada64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:35.885213 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-356bba8b-9672-456b-b509-374b8f1ada64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:35.885605 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-356bba8b-9672-456b-b509-374b8f1ada64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:35.886532 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-356bba8b-9672-456b-b509-374b8f1ada64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:35.886971 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-356bba8b-9672-456b-b509-374b8f1ada64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:36.038678 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-356bba8b-9672-456b-b509-374b8f1ada64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:36.046191 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-356bba8b-9672-456b-b509-374b8f1ada64 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1517 microversion: 2.1 time: 0.171117 Aug 04 14:15:36.046750 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 851/1672] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:35 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:37.063399 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-a1044c5c-ce3a-41e7-a6b4-c7b23b5826bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:37.064566 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-a1044c5c-ce3a-41e7-a6b4-c7b23b5826bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:37.072446 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1044c5c-ce3a-41e7-a6b4-c7b23b5826bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:37.072887 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1044c5c-ce3a-41e7-a6b4-c7b23b5826bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:37.073646 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1044c5c-ce3a-41e7-a6b4-c7b23b5826bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:37.074077 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-a1044c5c-ce3a-41e7-a6b4-c7b23b5826bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:37.212914 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-a1044c5c-ce3a-41e7-a6b4-c7b23b5826bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:37.220284 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-a1044c5c-ce3a-41e7-a6b4-c7b23b5826bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1519 microversion: 2.1 time: 0.161155 Aug 04 14:15:37.220855 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 822/1673] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:37 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:38.103201 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:15:38.103784 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:15:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:15:38.176348 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-0933073f-7aee-4742-9bde-70238ed25f6b req-48412729-0b1e-409b-bc8b-6ff811e11227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd01693-99b6-432d-9f29-398436ac094c", "name": "network-vif-unplugged", "status": "completed", "tag": "ebae422b-a52d-4e9b-b4af-0690ae37c4d6"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:38.177842 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:15:38.177842 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:15:38.185598 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-0933073f-7aee-4742-9bde-70238ed25f6b req-48412729-0b1e-409b-bc8b-6ff811e11227 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:38.186357 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-0933073f-7aee-4742-9bde-70238ed25f6b req-48412729-0b1e-409b-bc8b-6ff811e11227 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:38.197648 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-0933073f-7aee-4742-9bde-70238ed25f6b req-48412729-0b1e-409b-bc8b-6ff811e11227 service nova] Creating event network-vif-unplugged:ebae422b-a52d-4e9b-b4af-0690ae37c4d6 for instance 7dd01693-99b6-432d-9f29-398436ac094c on hv-cinder-79264 Aug 04 14:15:38.204066 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-0933073f-7aee-4742-9bde-70238ed25f6b req-48412729-0b1e-409b-bc8b-6ff811e11227 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031424 Aug 04 14:15:38.204684 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 852/1674] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:15:38 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:38.238637 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-35e50472-e2e3-4812-a7cb-834e0224a866 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:38.239251 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-35e50472-e2e3-4812-a7cb-834e0224a866 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:38.245367 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-35e50472-e2e3-4812-a7cb-834e0224a866 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:38.245785 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-35e50472-e2e3-4812-a7cb-834e0224a866 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:38.246651 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-35e50472-e2e3-4812-a7cb-834e0224a866 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:38.247013 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-35e50472-e2e3-4812-a7cb-834e0224a866 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:38.365977 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-35e50472-e2e3-4812-a7cb-834e0224a866 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:38.373381 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-35e50472-e2e3-4812-a7cb-834e0224a866 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1575 microversion: 2.1 time: 0.138556 Aug 04 14:15:38.373938 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 823/1675] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:38 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1575 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:39.389579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-7d8596b5-4e5c-4927-ac49-c142815666d4 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:39.390284 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-7d8596b5-4e5c-4927-ac49-c142815666d4 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:39.396414 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d8596b5-4e5c-4927-ac49-c142815666d4 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:39.396892 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d8596b5-4e5c-4927-ac49-c142815666d4 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:39.397660 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d8596b5-4e5c-4927-ac49-c142815666d4 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:39.398096 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-7d8596b5-4e5c-4927-ac49-c142815666d4 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:39.537178 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-7d8596b5-4e5c-4927-ac49-c142815666d4 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:39.544558 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-7d8596b5-4e5c-4927-ac49-c142815666d4 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1575 microversion: 2.1 time: 0.159090 Aug 04 14:15:39.545128 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 853/1676] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:39 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:40.561834 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-3c04c880-5b55-47a7-8d41-eb5dab8384b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:40.562377 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-3c04c880-5b55-47a7-8d41-eb5dab8384b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:40.568174 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c04c880-5b55-47a7-8d41-eb5dab8384b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:40.568639 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c04c880-5b55-47a7-8d41-eb5dab8384b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:40.569391 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c04c880-5b55-47a7-8d41-eb5dab8384b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:40.569814 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-3c04c880-5b55-47a7-8d41-eb5dab8384b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:40.687113 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-3c04c880-5b55-47a7-8d41-eb5dab8384b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:40.694454 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-3c04c880-5b55-47a7-8d41-eb5dab8384b2 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1575 microversion: 2.1 time: 0.136935 Aug 04 14:15:40.695022 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 824/1677] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:40 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1575 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:15:41.712173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-9b596221-be47-4358-bf04-6e90724226c8 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:41.712810 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-9b596221-be47-4358-bf04-6e90724226c8 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:41.718717 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b596221-be47-4358-bf04-6e90724226c8 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:41.719173 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b596221-be47-4358-bf04-6e90724226c8 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:41.719981 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b596221-be47-4358-bf04-6e90724226c8 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:41.720459 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-9b596221-be47-4358-bf04-6e90724226c8 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:41.840788 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-9b596221-be47-4358-bf04-6e90724226c8 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:41.848830 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-9b596221-be47-4358-bf04-6e90724226c8 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1575 microversion: 2.1 time: 0.140652 Aug 04 14:15:41.849398 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 854/1678] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:41 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1575 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:42.865750 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-0c56c6f5-8073-4602-b3f2-f0db26b907be tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:42.866384 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-0c56c6f5-8073-4602-b3f2-f0db26b907be tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:42.872226 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0c56c6f5-8073-4602-b3f2-f0db26b907be tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:42.872826 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0c56c6f5-8073-4602-b3f2-f0db26b907be tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:42.873695 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0c56c6f5-8073-4602-b3f2-f0db26b907be tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:42.874121 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-0c56c6f5-8073-4602-b3f2-f0db26b907be tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:42.994388 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-0c56c6f5-8073-4602-b3f2-f0db26b907be tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:43.001511 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-0c56c6f5-8073-4602-b3f2-f0db26b907be tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1575 microversion: 2.1 time: 0.139434 Aug 04 14:15:43.002069 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 825/1679] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:42 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:44.020257 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-2bc0ef14-6839-400f-9062-6aba6cee00bd tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:44.020916 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-2bc0ef14-6839-400f-9062-6aba6cee00bd tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:44.026711 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2bc0ef14-6839-400f-9062-6aba6cee00bd tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:44.027162 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2bc0ef14-6839-400f-9062-6aba6cee00bd tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:44.027930 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2bc0ef14-6839-400f-9062-6aba6cee00bd tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:44.028399 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-2bc0ef14-6839-400f-9062-6aba6cee00bd tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:44.145645 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-2bc0ef14-6839-400f-9062-6aba6cee00bd tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:44.152840 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-2bc0ef14-6839-400f-9062-6aba6cee00bd tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1575 microversion: 2.1 time: 0.136373 Aug 04 14:15:44.153410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 855/1680] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:44 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1575 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:45.166997 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e3a3344-7933-4f44-b101-0fa2c3ed818a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 14:15:45.170273 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-77fe4798-f8c5-45b7-a265-3b0503c49ea1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:45.170928 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-77fe4798-f8c5-45b7-a265-3b0503c49ea1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:45.176664 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-77fe4798-f8c5-45b7-a265-3b0503c49ea1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:45.177106 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-77fe4798-f8c5-45b7-a265-3b0503c49ea1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:45.177864 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-77fe4798-f8c5-45b7-a265-3b0503c49ea1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:45.178293 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-77fe4798-f8c5-45b7-a265-3b0503c49ea1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:45.303406 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-77fe4798-f8c5-45b7-a265-3b0503c49ea1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:45.310574 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-77fe4798-f8c5-45b7-a265-3b0503c49ea1 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1575 microversion: 2.1 time: 0.144899 Aug 04 14:15:45.311249 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 826/1681] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:45 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:46.328235 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-1b35bc1c-9b62-49b0-8f43-d938069b6c69 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:46.329401 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-1b35bc1c-9b62-49b0-8f43-d938069b6c69 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:46.335724 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b35bc1c-9b62-49b0-8f43-d938069b6c69 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:46.336164 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b35bc1c-9b62-49b0-8f43-d938069b6c69 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:46.336959 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b35bc1c-9b62-49b0-8f43-d938069b6c69 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:46.337383 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-1b35bc1c-9b62-49b0-8f43-d938069b6c69 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:46.472116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-1b35bc1c-9b62-49b0-8f43-d938069b6c69 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:46.479535 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-1b35bc1c-9b62-49b0-8f43-d938069b6c69 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1575 microversion: 2.1 time: 0.155352 Aug 04 14:15:46.480099 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 856/1682] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:46 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:47.497004 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-350a89f1-86a7-4b15-b0f2-2bfc38d5baca tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:47.497615 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-350a89f1-86a7-4b15-b0f2-2bfc38d5baca tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:15:47.514092 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-350a89f1-86a7-4b15-b0f2-2bfc38d5baca tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:47.515174 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-350a89f1-86a7-4b15-b0f2-2bfc38d5baca tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:47.515948 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-350a89f1-86a7-4b15-b0f2-2bfc38d5baca tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:47.516410 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-350a89f1-86a7-4b15-b0f2-2bfc38d5baca tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:47.521375 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e3a3344-7933-4f44-b101-0fa2c3ed818a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41680. Aug 04 14:15:47.640053 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-350a89f1-86a7-4b15-b0f2-2bfc38d5baca tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:47.647331 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-350a89f1-86a7-4b15-b0f2-2bfc38d5baca tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1562 microversion: 2.1 time: 0.154012 Aug 04 14:15:47.647898 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 827/1683] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:15:47 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:48.286860 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-476b3921-f4e1-4490-98a7-43aa2c06f998 req-26474f77-a952-4924-a028-7c83ecb8138e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd01693-99b6-432d-9f29-398436ac094c", "name": "network-vif-plugged", "status": "completed", "tag": "ebae422b-a52d-4e9b-b4af-0690ae37c4d6"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:48.288545 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:15:48.288545 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:15:48.295421 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-476b3921-f4e1-4490-98a7-43aa2c06f998 req-26474f77-a952-4924-a028-7c83ecb8138e service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:15:48.296410 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-476b3921-f4e1-4490-98a7-43aa2c06f998 req-26474f77-a952-4924-a028-7c83ecb8138e service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:15:48.307643 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-476b3921-f4e1-4490-98a7-43aa2c06f998 req-26474f77-a952-4924-a028-7c83ecb8138e service nova] Creating event network-vif-plugged:ebae422b-a52d-4e9b-b4af-0690ae37c4d6 for instance 7dd01693-99b6-432d-9f29-398436ac094c on hv-cinder-79264 Aug 04 14:15:48.313202 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-476b3921-f4e1-4490-98a7-43aa2c06f998 req-26474f77-a952-4924-a028-7c83ecb8138e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030067 Aug 04 14:15:48.314016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 857/1684] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:15:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:06.145193 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:17:06.145935 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:17:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:17:18.055688 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-1848ea39-cc41-4e24-b9fc-ebe7cb5f1140 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:18.056428 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1848ea39-cc41-4e24-b9fc-ebe7cb5f1140 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:17:18.062830 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1848ea39-cc41-4e24-b9fc-ebe7cb5f1140 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:18.063358 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1848ea39-cc41-4e24-b9fc-ebe7cb5f1140 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:18.064241 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1848ea39-cc41-4e24-b9fc-ebe7cb5f1140 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:18.064741 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-1848ea39-cc41-4e24-b9fc-ebe7cb5f1140 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:18.091503 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-1848ea39-cc41-4e24-b9fc-ebe7cb5f1140 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Going to try to terminate instance {{(pid=107823) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 04 14:17:18.125921 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [req-ef699d81-e104-4489-9eee-926c70f85185 req-77eac088-aa6a-4a93-a93d-ab4a9dc2f0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd01693-99b6-432d-9f29-398436ac094c", "tag": "ebae422b-a52d-4e9b-b4af-0690ae37c4d6"}]} {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:18.127829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:17:18.127829 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: warnings.warn(msg) Aug 04 14:17:18.136139 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-ef699d81-e104-4489-9eee-926c70f85185 req-77eac088-aa6a-4a93-a93d-ab4a9dc2f0e2 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:18.136616 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [req-ef699d81-e104-4489-9eee-926c70f85185 req-77eac088-aa6a-4a93-a93d-ab4a9dc2f0e2 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:18.148977 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.compute.server_external_events [req-ef699d81-e104-4489-9eee-926c70f85185 req-77eac088-aa6a-4a93-a93d-ab4a9dc2f0e2 service nova] Creating event network-changed:ebae422b-a52d-4e9b-b4af-0690ae37c4d6 for instance 7dd01693-99b6-432d-9f29-398436ac094c on hv-cinder-79264 Aug 04 14:17:18.153919 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [req-ef699d81-e104-4489-9eee-926c70f85185 req-77eac088-aa6a-4a93-a93d-ab4a9dc2f0e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101640 Aug 04 14:17:18.154513 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 858/1685] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:17:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:17:18.171055 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-1848ea39-cc41-4e24-b9fc-ebe7cb5f1140 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 204 len: 0 microversion: 2.1 time: 0.121620 Aug 04 14:17:18.171734 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 828/1686] 10.222.0.43 () {58 vars in 1239 bytes} [Wed Aug 4 14:17:18 2021] DELETE /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:17:18.180896 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-d56a8fba-ea59-4781-bb15-bce5d90a2915 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:18.181681 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-d56a8fba-ea59-4781-bb15-bce5d90a2915 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:17:18.198162 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d56a8fba-ea59-4781-bb15-bce5d90a2915 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:18.198736 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d56a8fba-ea59-4781-bb15-bce5d90a2915 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:18.199614 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d56a8fba-ea59-4781-bb15-bce5d90a2915 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:18.200116 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-d56a8fba-ea59-4781-bb15-bce5d90a2915 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:18.329901 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-d56a8fba-ea59-4781-bb15-bce5d90a2915 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:18.338161 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-d56a8fba-ea59-4781-bb15-bce5d90a2915 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1568 microversion: 2.1 time: 0.162161 Aug 04 14:17:18.338725 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 859/1687] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:17:18 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:19.399295 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-99f4e1d2-cb72-46df-8908-48b9db31ca62 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:19.399990 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.compute.api [None req-99f4e1d2-cb72-46df-8908-48b9db31ca62 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107823) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:17:19.405808 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99f4e1d2-cb72-46df-8908-48b9db31ca62 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:19.406248 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99f4e1d2-cb72-46df-8908-48b9db31ca62 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:19.407001 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99f4e1d2-cb72-46df-8908-48b9db31ca62 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:19.407427 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [None req-99f4e1d2-cb72-46df-8908-48b9db31ca62 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:19.532747 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.policy [None req-99f4e1d2-cb72-46df-8908-48b9db31ca62 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:19.540236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-99f4e1d2-cb72-46df-8908-48b9db31ca62 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1449 microversion: 2.1 time: 0.188575 Aug 04 14:17:19.540821 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 829/1688] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:17:19 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1449 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:20.557737 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-97a6f057-6b79-4fa7-9e0a-b3826bc325bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:20.558356 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-97a6f057-6b79-4fa7-9e0a-b3826bc325bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:17:20.564146 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97a6f057-6b79-4fa7-9e0a-b3826bc325bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:20.564634 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97a6f057-6b79-4fa7-9e0a-b3826bc325bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:20.565417 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97a6f057-6b79-4fa7-9e0a-b3826bc325bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:20.565852 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-97a6f057-6b79-4fa7-9e0a-b3826bc325bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:20.627016 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.policy [None req-97a6f057-6b79-4fa7-9e0a-b3826bc325bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b5e49a7af042d1b3d6fe25d65fcb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835631bcfda04e928702f87e8c8ce56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:20.635976 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-97a6f057-6b79-4fa7-9e0a-b3826bc325bc tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 200 len: 1381 microversion: 2.1 time: 0.082102 Aug 04 14:17:20.636579 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 860/1689] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:17:20 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 1381 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:20.688030 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [req-482f02ba-eb1e-4153-90b0-a859e8734505 req-66f0587e-a059-4f3c-8c23-5cda950fed82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd01693-99b6-432d-9f29-398436ac094c", "name": "network-vif-deleted", "tag": "ebae422b-a52d-4e9b-b4af-0690ae37c4d6"}]} {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:20.689586 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:17:20.689586 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: warnings.warn(msg) Aug 04 14:17:20.696236 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-482f02ba-eb1e-4153-90b0-a859e8734505 req-66f0587e-a059-4f3c-8c23-5cda950fed82 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:20.696687 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG oslo_concurrency.lockutils [req-482f02ba-eb1e-4153-90b0-a859e8734505 req-66f0587e-a059-4f3c-8c23-5cda950fed82 service nova] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:20.707192 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.compute.server_external_events [req-482f02ba-eb1e-4153-90b0-a859e8734505 req-66f0587e-a059-4f3c-8c23-5cda950fed82 service nova] Creating event network-vif-deleted:ebae422b-a52d-4e9b-b4af-0690ae37c4d6 for instance 7dd01693-99b6-432d-9f29-398436ac094c on hv-cinder-79264 Aug 04 14:17:20.712853 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [req-482f02ba-eb1e-4153-90b0-a859e8734505 req-66f0587e-a059-4f3c-8c23-5cda950fed82 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083700 Aug 04 14:17:20.713424 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 830/1690] 10.222.0.43 () {64 vars in 1318 bytes} [Wed Aug 4 14:17:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:21.652602 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '>' {{(pid=107822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:21.653209 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.compute.api [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] [instance: 7dd01693-99b6-432d-9f29-398436ac094c] Fetching instance by UUID {{(pid=107822) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 04 14:17:21.659063 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:21.659506 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:21.660294 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 04 14:17:21.660726 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG oslo_concurrency.lockutils [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Lock "0356dad4-e903-4b66-9c79-fb26cbe69de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 04 14:17:21.673816 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.wsgi [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] HTTP exception thrown: Instance 7dd01693-99b6-432d-9f29-398436ac094c could not be found. Aug 04 14:17:21.674398 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: DEBUG nova.api.openstack.wsgi [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Returning 404 to user: Instance 7dd01693-99b6-432d-9f29-398436ac094c could not be found. {{(pid=107822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 04 14:17:21.675199 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO nova.api.openstack.requestlog [None req-cad9f3f5-3653-4ae7-81aa-4bca73ba8fe6 tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c" status: 404 len: 111 microversion: 2.1 time: 0.026300 Aug 04 14:17:21.675715 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: [pid: 107822|app: 0|req: 861/1691] 10.222.0.43 () {58 vars in 1236 bytes} [Wed Aug 4 14:17:21 2021] GET /compute/v2.1/servers/7dd01693-99b6-432d-9f29-398436ac094c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:17:21.842509 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: DEBUG nova.api.openstack.wsgi [None req-85758f1d-3866-45ab-8ce0-5455f551173b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] Calling method '.version_select at 0x7efe7c2dee50>' {{(pid=107823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:21.866659 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO nova.api.openstack.requestlog [None req-85758f1d-3866-45ab-8ce0-5455f551173b tempest-TestShelveInstance-1012743099 tempest-TestShelveInstance-1012743099-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-681448557" status: 202 len: 0 microversion: 2.1 time: 0.028120 Aug 04 14:17:21.867436 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: [pid: 107823|app: 0|req: 831/1692] 10.222.0.43 () {58 vars in 1251 bytes} [Wed Aug 4 14:17:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-681448557 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:18:17.793983 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:18:17.794553 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:18:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:18:19.024911 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:18:19.025513 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:18:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:20:17.752539 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:20:17.753234 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:20:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:20:20.819095 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:20:20.819723 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:20:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:20:26.162586 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:20:26.163215 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:20:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:20:38.126249 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:20:38.127021 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:20:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:21:37.813958 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:21:37.814656 dv-cinder-792642-6-iscsi devstack@n-api.service[107822]: Wed Aug 4 14:21:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:21:39.042443 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:21:39.043040 dv-cinder-792642-6-iscsi devstack@n-api.service[107823]: Wed Aug 4 14:21:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!